LARGE DEVIATIONS OF THE EMPIRICAL FLOW FOR 
CONTINUOUS TIME MARKOV CHAINS 



LORENZO BERTINI, ALESSANDRA FAGGIONATO, AND DAVIDE GABRIELLI 

Abstract. We consider a continuous time Markov chain on a countable (fi- 
nite or infinite) state space and prove a joint large deviation principle for the 
empirical measure and the empirical flow, which accounts for the total number 
of jumps between pairs of states. We give a direct proof using tilting and an 
undirect one by contraction from the empirical process. 

Keywords: Markov chain, Large deviations principle, Entropy, Empirical flow. 
AMS 2010 Subject Classification: 60F10, 60J27; Secondary 82C05. 



1. Introduction 

One of the most important contribution in the theory of large deviations is the 
series of papers of Donsker and Varadhan [T7] . Here the authors develop a general 
approach to the study of large deviations for Markov processes both in continuous 
and discrete time. They establish large deviations principles (LDP) for the empirical 
measure and for the empirical process associated to a Markov process. 

Given a sample path of the process on the finite time window [0,T], the cor- 
responding empirical measure is a probability measure on the state space that 
associates to any measurable subset the fraction of time spent on it. A LDP for 
the empirical measure is usually called a level 2 LDP. 

Given a sample path of the process in the finite time window [0,T], the corre- 
sponding empirical process is a probability measure on paths defined on the infinite 
time window (— oo, +oo). More precisely it is the unique stationary (with respect 
to time shift) probability measure that gives weight 1 to periodic paths (of period 
T) such that there exists a period [t, t + T] where they coincide with the original 
sample path. A LDP for the empirical process is usually called a level 3 LDP. 

Let us restrict our discussion to the case of a Markov chain on a countable (finite 
or infinite) state space, which is the actual framework of this paper. The case of 
discrete time Markov chains has been much more investigated with respect to the 
case of continuous time. 

The general picture of the discrete time case is the following (see for example 
[Pol [22]). The rate function for the level 3 LDP coincides with the relative en- 
tropy density. The rate function for the level 2 LDP has instead in general only 
a variational representation, which cannot be solved explicitly even for symmetric 
jump probabilities. A very natural and much studied object is the /c -symbols em- 
pirical measure. This is a probability measure on strings of symbols with length 
k obtained from the frequency of appearance in the sample path. With a suitable 
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periodization procedure the fc-symbols empirical measures constitute a consistent 
family of measures that are exactly the k marginals of the empirical process. For 
each k > 1 , and in particular for k = 2 the rate function for the LDP associated to 
the k symbols empirical measure has an explicit expression. 

In the continuous time setting, quite surprisingly, there are much less results 
available and the general picture is less clear. The aim of this paper is to partly fill 
the gap. As already mentioned, level 2 and level 3 LDPs have been proved in |17j . 
For the empirical process the rate function is the relative entropy density. For the 
empirical measure the rate function has instead only a variational representation. 
Only in the case of reversible Markov chains the corresponding variational problem 
can be solved and the rate function is related to the Dirichlet form. 

In the continuous time setting a natural generalization of the 2-symbols empirical 
measure is the so called empirical flow. Given a sample path of the Markov chain 
in the finite time window [0,T], the corresponding empirical flow is a measure 
on the pairs of states, assigning to each pair the number of jumps performed by 
the path along this pair of states times a factor 1/T. In this paper we prove a 
joint LDP for the empirical measure and the empirical flow. The rate function is 
explicit and is given by a sum of Poisson like terms constrained by a zero divergence 
condition for the empirical flow. The LDP is proved on the space of summablc flows 
with a suitable topology but also some other topological frameworks arc discussed. 
Despite the discrete time case in which the empirical measure is the marginal of 
the empirical 2-symbols measure, in the continuous time case empirical measure 
and flow can be arbitrary and have not to satisfy any compatibility condition. 

The joint rate function for the empirical measure and flow first appeared in [53] 
through an heuristic derivation. Always in |24j it was then used to recover by con- 
traction the Donsker-Varadhan rate function for the empirical measure in the case 
of a state space with only two elements. Being a LDP intermediate among level 2 
and level 3, the authors called it a level 2.5 LDP. Later in j2], motivated by statis- 
tical applications, the authors have showed that the contraction on the empirical 
measure of the rate function proposed by [24] leads to the Donsker-Varadhan rate 
function in the case of finite state space. In [14] a weak level 2.5 LDP has been 
proved. Finally in jlj LDPs for flows and currents have been discussed in relation 
to non equilibrium thermodynamics. 

In the present paper we give a rigorous proof of a full LDP for Markov chains 
on a countable state space. As a condition assuring the exponential tightness we 
assume a stronger version of the Donsker-Varadhan condition (alternatively of the 
hypcrcontractivity condition in [16) ) for the exponential tightness of the empirical 
measure. For a finite state space the exponential tightness is trivially satisfied, 
and the proof is strongly simplified. We present two different approaches: a direct 
derivation is obtained using a perturbation of the original Markov measure (under 
an additional technical assumption), while an indirect derivation is obtained by 
contraction from the level 3 LDP. 

In [7] we will recover the LDP for the empirical measure by contraction from 
the joint LDP proved here. In a companion paper [5] we will discuss several appli- 
cations and consequences of our results like LDPs for currents, Gallavotti-Cohen 
symmetries and computations in specific models. 

Finally we mention some recent results about fluctuations of currents and fluxes 
inspiring and motivating the present work. We already mentioned the paper [I]. 
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In [H SJ [5j El [TOl QT] LDPs for currents of interacting particle systems in the hy- 
drodynamic scaling limit were studied. This was a breakthrough in the study of 
non equilibrium models of interacting particle systems that for example revealed 
the possibility of a dynamical phase transition based on current fluctuations. LDPs 
for the currents in diffusion processes on R n and their symmetries were studied in 
[6]. In [26] and [27] LDPs for the currents of the Brownian motion on a compact 
Riemann manifold arc obtained. We mention also the recent preprint |31j on the 
joint large deviations for the empirical measure and flow for a renewal process on 
a finite graph. 

In the next section we fix our notation and state our main results. At the end 
of that section we outline the structure of the paper. 

2. Notation and results 

We consider a continuous time Markov chain ( t , J 6 M + on a countable (finite 
or infinite) state space V. The Markov chain is defined in terms of the jump 
rates r(x,y), x =/= y in V, from which one derives the holding times and the jump 
chain }36[ Section 2.6]. Since the holding time at x £ V is an exponential random 
variable of parameter r(x) :— J2 y ev r ( x > v)' we nce d to assume that r(x) < +oo 
for any x £ V. Note that, in some cases, we allow arbitrary long jumps, i.e. 
\{y £ V : r(x,y) > 0}| = +oo. 

The basic assumptions on the chain are the following: 

(Al) for each x £ V, r(x) = J2 yeV r(x,y) is finite; 

(A2) for each x £ V the Markov chain £f starting from x has no explosion a.s.; 
(A3) the Markov chain is irreducible, i.e. for each x,y £ V and t > the event 

{£? = y} nas strictly positive probability; 
(A4) there exists a unique invariant probability measure, that is denoted by ir. 

As in [36], by invariant probability measure ir we mean a probability measure 
on V such that 

^2 n(x)r(x,y) = n(y)r(y,x) Vx£V (2.1) 

y£V y£V 

where we understand r(x,x) = 0. We recall some basic facts from [36] . see in 
particular Section 3.5 and Theorem 3.8.1 there. Assuming (Al) and irreducibility 
(A3), assumptions (A2) and (A4) together are equivalent to the fact that all states 
are positive recurrent. In (A4) one could remove the assumption of uniqueness of 
the invariant probability measure, since for an irreducible Markov chain there can 
be at most only one. Under the above assumptions, w(x) > for all x £ V, the 
Markov chain starting with distribution 7r is stationary (i.e. its law is left invariant 
by time-translations), and the ergodic theorem holds, i.e. for any bounded function 
/ : V — > R and any initial distribution 

hm 1 f T dtm) = {7T,f) a.s. (2.2) 

where (tt, f) denotes the expectation of / with respect to ir. Finally, we observe 
that if V is finite then (Al) and (A2) are automatically satisfied, while (A3) implies 
(A4). 

We consider V endowed with the discrete topology and the associated Borcl a- 
algcbra given by the collection of all the subsets of V. Given x £ V, the distribution 
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of the Markov chain £f starting from a;, is a probability measure on the Skorohod 
space D(M.+ ;V) that we denote by ¥ x . The expectation with respect to P T is 
denoted by E^. In the sequel we consider D(IR + ; V) equipped with the canonical 
filtration, the Skorohod topology, and the completion of the associated Borel a- 
algcbra with respect to P x , x € V. The canonical coordinate in D(R + ;V) is 
denoted by X t . The set of probability measures on V is denoted by V(V) and it 
is considered endowed with the topology of weak convergence and the associated 
Borel cr-algebra. Since V has the discrete topology, the weak convergence of fj,„ 
to /i in V(V) is equivalent to the pointwise convergence of to n{x) for any 

x G V. 

2.1. Empirical measure and empirical flow. Given T > the empirical mea- 
sure [i T : D(R+;V) -> V(V) is defined by 

MT (x)=iy dts Xt 

where 5 y denotes the pointmass at y. Given x € V, the ergodic theorem (|2.2[) 
implies that the empirical measure \it converges P^ a.s. to 7r as T — > oo. In 
particular, the sequence of probabilities {P x o /^^ 1 }t>o on V(V) converges to 5^. 

We denote by B the countable set of ordered edges without loops in V and by 
E the subset of B given by ordered edges with strictly positive jump rate: 

B:={(y,z)eVxV:y^z}, 
E:={(y,z)eB : r(y,z)>0}. 

For each T > we define the empirical flow as the map Qt '■ D(M.+ ; V) — > [0, +oo] s 
given by 

Q T (y,z)(X):=^ ]T S y (X t -)6 z (X t ) (y,z)eB. (2.3) 

0<t<T 

Namely, TQx(y, z) is ¥ x a.s. the number of jumps from y to z in the time interval 
[0, T] of the Markov chain £ x . 

Remark 2.1. By the graphical construction of the Markov chain, the random 
field {TQx{y, z)}( y z }£B under P x is stochastically dominated by the random field 
{Zy^ z }(y.z)eB given by independent Poisson random variables, Z y . z having mean 
Tr(y,z). This fact will be frequently used in the rest of the paper. 

Wc denote by ^(E) the collection of absolutely summablc functions on E and by 
|| • || the associated L 1 -norm. The set of nonnegative elements of ^(E) is denoted 
by L+(E). In what follows, given Q € wc will think of Q as element of [0, +oo] s 
setting Q(y, z) := for all (y, z) € B\E. In particular, we have the inclusions 

L\{E) cMf C [0,+oo] s . 

Due to the above identification, since the chain is not explosive, for each T > we 
also have P^ a.s. that Qt € L\{E). 

Given a flow Q £ L^_(E) we let its divergence divQ: V —> ffi be the function 
defined by 

divQ( y )= Q(y> z )- E ^y)' y eV - ( 2 - 4 ) 

z:(y,z)£E z:(z,y)eE 
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Namely, the divergence of the flow Q at y is given by the difference between the 
flow exiting from y and the flow entering into y. Observe that the divergence maps 
L\{E) into L 1 ^). 

Finally, to each probability fj, £ V(V) we associate the flow £ R;? defined by 

Q»(y,z):=tJL(y)r(y,z) (y,z)eE. (2.5) 

Note that Q M £ L+(E) if and only if (/i,r) < +00. Moreover, in this case, by (|2.1[) 
QV- has vanishing divergence if only if /1 is invariant for the Markov chain £, i.e. 

/i = 7T. 

We now discuss the law of large numbers for the empirical flow. As follows from 
simple computations (see [351 Lemma II. 2. 3] and |25| App. I, Lemma 5.1], which 
have to be generalized to the case of unbounded r(-) by means of [36] Sec. 2.8] and 
Remark l2.I[) for each (y, z) £ E the process 

M T (y,z)=TQ T (y,z)(X)- [ dsS y (X s )r(y,z) (2.6) 

Jo 

is a martingale with respect to P x , x G V. Moreover, the predictable quadratic 
variation of Mj-(i/, z), denoted by (M(y, z))t is given by 

(M(y,z)) T = [ dsS y (X s )r{y,z). 
Jo 

In view of the ergodic theorem (|2.2[) . we conclude that for each x £ V and (y, z) £ E 
the family of real random variables Qr(y, z) converges, in probability with respect 
to Pa;, as T — > +00 to Q^(y, z). We refer to Remark 13.31 for an alternative proof. 

2.2. Compactness conditions. The classical Donsker-Varadhan theorem jl7 [ [T5 l 
[TBI I3T] describes the LDP associated to the empirical measure. The main purpose 
of the present paper is to extend this result by considering also the empirical flow. 

Below we will state two LDPs (Theorem 12.51 and Theorem 12. 8j) for the joint 
process given by the empirical measure and flow. In Theorem 12.51 the flow space is 
given by L^(E) endowed of the bounded weak* topology and, in order to have some 
control at infinity in the case of infinite state space V, compactness assumptions 
are required. In Theorem 12.81 the flow space is given by [0,+oo] B endowed of the 
product topology and weaker assumptions are required (the same of [17]). On the 
other hand, the rate function has not always a computable form. 

Let us now state precisely the compactness conditions under which Theorem [53] 
holds (at least one of the following Conditions 12.21 [2~3l has to be satisfied). To this 
aim, given /: V — s- R such that ^Z yeV r{x,y) \f{y)\ < +00 for each x £ V, we 
denote by Lf : V — > R the function defined by 

Lf(x):=Ylr(x,y)[f(y)-f{x)], x £ V. (2.7) 
yev 

Condition 2.2. There exists a sequence of functions u n : V — > (0, +00) satisfying 
the following requirements: 

(i) For each x £ V and n £ N it holds X^ev r ( x i y) u n{y) < +00. In the sequel 
Lu n : V — > R is the function defined by (|2.7j) . 

(ii) The sequence u n is uniformly bounded from below. Namely, there exists 
c > such that u n (x) > c for any x £ V and n £ N. 
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(iii) The sequence u n is uniformly bounded from above on compacts. Namely, 
for each x £ V there exists a constant C x such that for any n 6 N it holds 
u n (x) < C x . 

(iv) Set v n := —Lu n /u n . The sequence v n : V — > R converges pointwise to some 
v: V R. 

(v) The function v has compact level sets. Namely, for each £ € R the level set 
{x <E V : v(x) < is finite. 

(vi) There exist a strictly positive constant a and a positive constant C such 
that v > a r — C . 

Replacing in Condition 12 . 2 1 the strictly positive constant a with zero one obtains 
the same assumptions of Donsker and Varadhan for the derivation in [17] -(IV) of 
the LDP for the empirical measure of the Markov chain satisfying (Al ),..., (A4) 
(shortly, we will say that the Donsker- Varadhan condition is satisfied). 

We recall that the Donsker- Varadhan theorem for the empirical measure still 
holds under a suitable compactness condition concerning the hypercontractivity of 
the underlying Markov semigroup, see e.g. [16] . Also in this case we need a stronger 
version that is detailed below. 

Recall that 7r is the unique invariant measure of the chain. The maps Ptf(x) := 
E(/(£f )), t G R + , define a strongly continuous Markov semigroup on L 2 (V, n). We 
write for the Dirichlet form associated to the symmetric part S = (C + C*)/2 
of the generator L in L 2 (V,ir). Since the time-reversed dynamics is described by a 
Markov chain on V with transition rates r*(x,y) := ir(y)r(y , x) /ir(x) , it holds 

D M) = \ E E (*(*)r(x t y) + n(y)r(y, x)) (f(y) - f{x)f , / € L 2 (V, n) . 

x£V y£V 

(2.8) 

One can take the above expression as definition of D^, avoiding all technicalities 
concerning infinitesimal generators. One says that the Markov chain £ satisfies the 
logarithmic Sobolev inequality if there exists a constant cls G (0, +oo) such that 
for any /i <G V(V) it holds 

EntGu|vr) < c LS Ar (v^) (2-9) 
where Ent(/^|7r) denotes the relative entropy of fi with respect to tt. 

Condition 2.3. 

(i) The Markov chain satisfies a logarithmic Sobolev inequality. 

(ii) The exit rate r has an exponential moment with respect to the invariant 
measure. Namely, there exists a > such that <V,cxp jc?'}) < +oo. 

(iii) The graph (V, E) is locally finite, that is for each vertex y € V the number 
of incoming and outgoing edges in y is finite. 

Item (iii) is here assumed for technical convenience and it should be possible to 
drop it. Item (i) is the hypercontractivity condition assumed in ]16] to deduce the 
Donsker- Varadhan theorem for the empirical measure. Item (ii) is here required to 
prove the exponential tightness of the empirical flow in L l + (E). 

2.3. LDP with flow space L\(E) endowed of the bounded weak* topology. 

We consider the space L 1 (£') equipped with the so-called bounded weak* topology. 
This is defined as follows. Recall that the (countable) set E is the collection of 
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ordered edges in V with positive jump rate. Let Cq(E) be the collection of the 
functions F : E — > K vanishing at infinity, that is the closure of the functions with 
compact support in the uniform topology. The dual of Cq{E) is then identified 
with The weak* topology on ^{E) is the smallest topology such that the 

maps Q e L X (E) -> (Q,f) £ K with / G C (E) are continuous. Given I > 0, 
let B £ := {Q G i x (S) : ||Q|| < i) be the closed ball of radius £ in L^E) (|| • || 
being the standard L 1 -norm). In view of the separability of Cq(E) and the Banach- 
Alaoglu theorem, the set endowed with the weak* topology is a compact Polish 
space. The bounded weak* topology on ^(E) is then defined by declaring a set 
A C open if and only if A PI Bg is open in the weak* topology of Be for any 

I > 0. The bounded weak* topology is stronger than the weak* topology (they 
coincide only when \E\ < +oo) and for each I > the closed ball Bg is compact 
with respect to the bounded weak* topology. The space L X {E) endowed with the 
bounded weak* topology is a locally convex, complete linear topological space and 
a completely regular space (i.e. for every closed set C C ^(E) and every element 
Q G ^(E) \ C there exists a continuous function / : ^(E) — > [0,1] such that 
f(Q) = 1 and f(Q') = for all Q' € C). Moreover, it is metrizablc if and only if 
the set E is finite. We refer to [32J Sec. 2.7] for the proof of the above statements 
and for further details. 

We regard L l + {E) as a (closed) subset of ^{E) and consider it endowed with the 
relative topology and the associated Borel er-algebra. Accordingly, the empirical 
flow Qt will be considered as a measurable map from D(R + ; V) to L\{E), defined 
ir x a.s., X G V. Recalling that we consider V(V), the set of probability measures 
on V , with the topology of weak convergence, we finally consider the product space 
V(V) x L+(E) endowed with the product topology and regard the couple (/xt, Qt) 
where [It is the empirical measure and Qt the empirical flow, as a measurable map 
from D(R + ; V) to V(V) x L\{E) defined P x a.s., x € V. 

Below we state the LDP for the family of probability measures on V(V) x L\{E) 
given by {P^ o (^t,<3t) -1 } asT4 +oo. Before stating precisely the result, we 
introduce the corresponding rate function. Let $ : R + x R + — > [0, +oo] be the 
function defined by 



We point out that, given p > and letting Nt, t G R + be a Poisson process 
with parameter p, the sequence of real random variables {Nt/T} satisfies a large 
deviation principle on R with rate function $(-,p) as T — > oo. This statement can 
be easily derived from the Gartner-Ellis theorem, see e.g JTSJ Thm. 2.3.6]. Recalling 
flOJ) and ([231), wc lct /: "P(V) x L\(E) -t [0, +oo] be the functional defined by 




q log (q-p) if q,P G (0,+oo) 

P 

p if q = 0, p G [0,+oo) 

+oo if p = and g £ (0, +oo). 



(2.10) 




3>{Q(y,z),Q»(y,z)) if div Q = , (/i, r) < +oo 



otherwise. 



(2.11) 



Remark 2.4. ^4s proved in Appendix\E\ if (/j,, r) = +oo the series in (|2.1ip diverges. 
Hence the condition (fJ,,r) < +oo can be removed from the first line of (|2.11l) . 
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Theorem 2.5. Assume the Markov chain satisfies (A1)-(A4) and at least one be- 
tween Conditions \2.2\ and \2.3i Then as T — > +00 the family of probability measures 
{P x o ([It, Qt) -1 } on V(y) x L i + {E) satisfies a large deviation principle, uniformly 
for x in compact subsets of V , with good and convex rate function I. Namely, for 
each not empty compact set K C V , each closed set C C V(V) x L+(E), and each 
open set ACP(V) x L\(E), it holds 

hm" sup ^logP, ((ht,Qt) e c) < - inf I{fi,Q), (2.12) 



t^+oo xeK TV / (m,Q)gC 

lim inf ^\ogP x ((n T ,Q T ) e A) >- inf I(p,Q). (2.13) 



t^+oo TV / (fj.,Q)eA 

As discussed in Lemma 13.91 under the above assumptions it holds (tt, r) < +00. 
In particular, I(/j,,Q) = if and only if (/j,,Q) = (tt, Hence, from the above 
LDP one derives the LLN for the empirical flow in L^(E), improving the pointwise 
version discussed at the end of Section [2~T1 In addition, the function /(-, •) has an 
affinc structure: 

Proposition 2.6. Let (fi,Q) € V(V) x L\(E) satisfy I(fJ.,Q) < +00. Then 

(i) All edges in the support E(Q) of Q must connect vertexes in the support of 
/j,, i.e. if Q(y,z) > then y,z € supp(n). 

(ii) I(fi, Q) has the following affine decomposition. Consider the oriented graph 
(supp(fi), E(Q)) and let Kj, j £ J, be the family of its oriented connected 
components. Consider the probability measure fij on V concentrated on Kj 
defined as /ij := . Consider the flow Qj £ L^(E) defined as 




if (y, z) e E, y,z £ Kj , 
otherwise . 



Then we have (fJ,,Q) = ^2j^j fJ'(Kj)(fXj,Qj) and 



IM) = Y,l*{K i )I{n } ,Qj). (2.14) 

(iii) The oriented connected components of the oriented graph (supp(fi), E{Q)) 
coincide with the connected components of the unoriented graph 
(supp(fi), E U {Q)), where 

E U (Q) := { {y, z} : (y, z) £ E(Q) or (z, y) £ E(Q)} . 

For the unfamiliar reader, the definition of (oriented) connected components is 
recalled after Remark I4T21 Note that the oriented components of (supp(/ti), E(Q)) 
coincide with the irreducible classes of the Markov chain on supp(/x) with transi- 
tion rates r(y,z) := Q(y,z)/fj,(y). Moreover, note that due to Item (i) the graph 
(supp(/x), E(Q)) is well defined. The proof of the above proposition is given after 
Lemma 14.31 



2.4. LDP with flow space [0,+oo] B endowed of the product topology. 

When considering the product topology on [0, +oc] B we take [0, +00] endowed of the 
metric making the map x — > £ [0,1] an isomctry. Namely, on [0, +00] we take 
the metric d(-, •) defined as d(x, y) = \x/(l + x) — y/(l + y)\ ■ It is standard to define 
on the space [0, +oo] B a metric D(-, ■) inducing the product topology: enumerating 
the bonds in B as 61,62,... we set D(Q,Q') := ^L=i 2~ n d(Q(b n ), Q'(b n )). 
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We write Ms for the space of stationary probabilities on Z)(R; V) endowed of the 
weak topology. Given R £ Ms we denote by J2(R) £ ViV) the marginal of R at a 
given time and by Q(R) the flow in [0, +oo} B defined as Q(R)(y, z) := E_r[Qt(2/, z)] 
for all (y, z) £ B, where E# denotes the expectation with respect to R. It is simple 
to check that the above expectation does not depend on the time T > 0: 

Lemma 2.7. Given an oriented bond (y, z) £ B and a stationary process R £ Ms, 
the expectation Ejj \Qt{u^ z)\ G [0, +oo] does not depend on T > 0. 

Proof. Since R is stationary, fixed t £ R it holds R(X t ^ X t _) = 0. In particular, 
given T > and an integer n for i?-a.a. X £ D(R; V) it holds 

^ n— 1 

Q T (y,z)(X) = -J2QT/ n (y,z)(6 jT/n X). 

H 3=0 

Above we have used the notation (6 s X) t := X s+t - From the above identity and the 
stationarity of R, taking the expectation w.r.t. R one gets f(T) = f(T/n), where 
f(T) := Er[Qt(v, z)\ . Then by standard arguments one gets that f(T) = /(l) as 
T varies among the positive rational numbers. Since for < t\ < T < t 2 it holds 
ti/(ti) < Tf(T) < ^2/(^2) it is trivial to conclude that f(T) is constant as T varies 
among the positive real numbers. □ 



We can now state our second main result: 



Theorem 2.8. Assume the Markov chain satisfies (Al)-(A4) together with Donsker- 
Varadhan condition. Consider the space V{V) x [0, +oo] s , with V{V) endowed of 
the weak topology and [0, +oo] s endowed of the product topology. Then the following 
holds: 

(i) As T — > +00 the family of probability measures {P x o(fj, Tl Qt) -1 } onV(V)x 
[0, +oo] B satisfies a large deviation principle with good rate function 

7( M , Q) := inf [h(R) : Re M s , Jt(R) = fi , Q(R) = Q} (2.15) 

Above H(R) denotes the entropy of R with respect to the Markov chain £ 
as defined in \17\—(IV) (see Section^. Moreover we have 

( Tfa,Q) = I(n,Q) ifQ£ L\(E) , 
\ 7(/a ! Q) = +oo i/Q^Mf . 

(ii) If in addition Condition \2.2\ is satisfied, then the rate function I is given by 

ifQeL + iE) > (2.17) 
I +cxd otherwise . 

Since Condition 12 .21 implies the Donsker Varadhan condition, the above theorem 
under Condition 12.21 implies the variational characterization 



I(n,Q)=w£{H(R) : R £ Ms , ?(-R)=M. Q(R) = Q} , (m, Q) G V{V)xL\{E) . 
In addition, note that (|2.16[) does not cover the case Q £ \ L+(E). 
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2.5. Outline. The rest of the paper is devoted to the proofs of Theorems 12.51 and 
12.81 Sections [3] and S] contain preliminary results. Then in Section[5]we give a direct 
proof of Theorem 12.51 For this proof it is necessary to add the condition that the 
graph (V, E) is locally finite. 

In Sections |6l [7] and [8] we remove the above condition and prove both Theorems 
12.51 and 12.81 by projection from the large deviations principle for the empirical pro- 
cess proven by Donsker and Varadhan in [E]-(IV). We discuss the details only for 
the Donsker- Varadhan type compactness conditions. For this reason, we added item 
(iii) as a separate requirement in the hypercontractivity type Condition 12.31 By 
using similar arguments to the ones here presented, it should be possible to remove 
it from Theorem [23] and prove the first statement in Theorem l2.8l bv assuming only 
items (i) and (ii) in Condition 12.31 

Finally, in Section [9] we discuss some examples from birth and death processes 
and compare the different compactness conditions. 



3. Exponential estimates 

In this section we collect some preliminary results that will enter in the proof of 
Theorems 12 . 51 and 12 . 81 Between other, we prove the exponential tightness in L+(E) 
of the empirical flow when at least one between Conditions 12.21 and 12.31 holds. 



3.1. Exponential local martingales. We start by comparing our Markov chain 
with a perturbed one. Let £ be a continuous time Markov chain on V with jump 
rates r(y, z), y ^ z in V. We assume that r(y) := J2zev ^XVi z ) < +°° f° r au V e V> 
thus implying that the Markov chain £ is well defined at cost to add a coffin state 
d to the state space in case of explosion [36j Ch. 2]. We write for the law on 
D(R+, V U {d}) of the above Markov chain £ starting at x € V. We denote by pr 
the map p T : D(R + ,V U {d}) -> D([0, T], V U {d}) given by restriction of the path 
to the time interval [0,T]. We now assume that r(y,z) = if (y,z) £ E. Then, 
restricting the probability measures P^op^ 1 and P^op^ 1 to the set D([0, T], V) (no 
explosion takes place in the interval [0,T]), we obtain two reciprocally absolutely 
continuous measures with Radon-Nykodim derivative 



° Pt r ml.. c _\i TT \r(y> z ) 



o pj} 



= exp{-T(p T ,r- r)} 

D 0,T,V) ,4*. 

(v,z)eE 



-,TQ T (y,z) 



(3.1) 



This formula can be checked very easily. Indeed, calling n (X) < T2 (X) < t^^x) (X) 
the jump times of the path X in [0, T] (below N(X) < +oo almost surely) we have 

F x o p~ x (N(X) = n , X(n) =Xi\/i:l<i<n, Ti € {U, U + dt % ) Vi : 1 < i < nj 

n-l 

= [ Y[ e- r ^^r(x„x t+1 )] e- r ^ T -^dh ■ ■ ■ dt n , 



where to ■= and x$ := x, < t\ < t 2 < ■ ■ ■ < t„ < T, n = 0, 1, 2, Since a 

similar formula holds also for the law ¥ x o p^, 1 , one gets (|3.ip . 

As immediate consequence of the Radon-Nykodim derivative (|3.ip we get the 
following result: 
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Lemma 3.1. Let F: E R be such that r F (y) := J2 Z r (v> z)e F( - v ' z) < +00 for 
any y G V. For t > define Mf : D(R + , V) (0, +00) as 



If := exp 



{t[(Q t ,F)-((, t ,r F -r)]} (3.2) 



where (Qt, F) = Yl( y z )eE Qt(Vi z )P(l/i z )- Then for each x £ V and t G M + it holds 
E X (M() < 1. 

Proof. By (r(y,z) := r(y, z)e F ^), E x (Mf) =¥ x (D([0,t];V)) < 1. □ 

Remark 3.2. .ft is simple to check that the process M F is a positive local martingale 
and a supermartingale with respect to ¥ x , x G V. 

Remark 3.3. Fixed (y, z) G E, taking in Lemma \3.1\ F := ±\5 y , z with A > 
and applying Chebyshev inequality, one gets for 5 > that the events {Qt(y,z) > 
IJ,t(y)r(y, z)(e x - 1)/A + 5} and {Q t { Vl z) < Ht{v)r{y, z)(l - e- A )/A - 6} have F x - 
probability bounded by e~* 5A . Using that (e ±A — 1)/A = ±1 + o(l) and since Ht{y) — > 
7r(y) ast—> +00 ¥ x -a.s. by the ergodic theorem (|2.2j) . taking the limit t — > +00 and 
afterwards taking S,X arbitrarily small, one recovers the LLN of Qt(y,z) towards 
■n{y)r{y,z) discussed in Section \2.1\ 



The next statement is deduced from the previous lemma by choosing there 
F(y, z) = \og[u(z)/u(y)}, (y, z) G E for some u: V —> (0, +00). 

Lemma 3.4. Let u: V — > (0, +00) be such that ^2 z r(y, z)u(z) < +00 for any 
y£V. Fort>0 define : D(R+,V) -> (0, +00) as 

Then for each x G V and t G M.+ it holds E x (M't) < 1. 

3.2. Exponential tightness. We shall prove separately the exponential tightness 
of the empirical measure and of the empirical flow. We first discuss the case in 
which Condition 12.21 holds. Then the proof of the exponential tightness of the 
empirical measure is essentially a rewriting of the argument in |17| in the present 
setting. On the other hand, the proof of the exponential tightness of the empirical 
flow depends on the extra assumption a > in item (vi) of Condition 12.21 



E 



Lemma 3.5. Assume Condition \2.2\ to hold and let the function v and the constants 
c, C x ,C,a be as in Condition \2.2\ Then for each x G V it holds 

x ( e *W>) < 9± , E x (e^^) < e TC ^f . (3.4) 

Proof. The second bound in (|3.4[) follows trivially from the first one and item (vi) 
in Condition l2.2l To prove the first bound, let u n be the sequence of functions on V 
provided by Condition 12.21 and recall that v n = —Lu n /u n . In view of the pointwise 
convergence of v n to v and Fatou lemma 

E,(e T ^>) <ljmE x (e T <^) = lim E K ( exp {t ~)}) < ^ 

where the last step follows from Lemma I3T41 and items (ii)-(iii) in Condition ^. 21 □ 

The following provides the exponential tightness of the empirical measure and 
the empirical flow. 
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Proposition 3.6. Assume Condition \2. 2\ For each x £ V there exists a sequence 
{ICe} of compacts in V(V) and a real sequence At f +00 such that for any i £ N 



lim -logF x (n T JCt) <-£, 



lim — los 



\Qt\\ >A e ) < -I. 



(3.5) 
(3.6) 



Proof. We first prove (|3.5[1 . For a sequence ag f +00 to be chosen later, set Kg := 
{x £ V : v(x) < ae}. In view of item (v) in Condition 12.21 Ki is a compact subset 
V . Set now 



In particular, the empirical measure and flow are exponentially tight. 



and observe that, by Prohorov theorem, Kg is a compact subset of V(V). 

From item (vi) in Condition 12.21 (for this step we only need it with a = 0) and 
the definition of Kg we deduce v > agin* — C. By the exponential Chebyshev 
inequality and Lemma l3.5l we then get 



( (MrW> j)<Px(<Mr,«)>y-C) 



< exp 



{ 



T 



Of 



C 



Cx 

< — exp • 

c 



T 



T 



c 



By choosing ag — I 2 + CI the proof is now easily concluded. 

Let us now prove p. 61) . By the second bound in Lemma 13.51 and Chebyshev 
inequality, P x ({fiT,f) > A) < e -T(o\-c) f or am7 ^ > q. In particular we obtain 
that 



F x ((nT,r)>A>)<^e- Te . 



A' e :=ct-V + C) 



Hence, it is enough to show that for each x £ V there exists a sequence Ae j" +00 
such that for any T > and any £ 6 N 



»»(||Qr|| > At, (fi T ,r) < A'^j < e 



(3.7) 



We consider the exponential local martingale of Lemma KTTl choosing there F : E 
K constant, F(x, y) = A £ (0, +00) for any (2, y) £ E. We deduce 



HQrll >A, (jMr,r) < A' e ) 



= E»c 



-T A||Q T ||-(e A -l)( MT ,r) 



T I {||QT||>A f } H(nT,r)<A> e } 

< exp { - T[\A e - (e A - 1)^] } 

where we used Lemma |3~T1 in the last step. The proof of (|3.7[) is now completed by 
choosing A e = X- 1 £ + \- 1 {e x - l)A' e . 

Recalling that the closed ball in L+{Ei) is compact with respect to the bounded 
weak* topology, the exponential tightness of the empirical flow is due to (|3.6|) . □ 



h 



We next discuss the exponential tightness when Condition 12.31 is assumed. 
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Proposition 3.7. Fix x G V. If item (i) in Condition \2.3\ holds then the sequence 
of probabilities {F x o /i^ 1 } on V(V) is exponentially tight. If furthermore it holds 
also item (ii) in Condition \ 2.3\ then the sequence of probabilities {V x oQ^ 1 } on 
L^_(E) is exponentially tight. 

While the first statement is a consequence of the general results in [IB], we next 
give a direct and alternative proof also of this result. We premise an elementary 
lemma. 

Lemma 3.8. Let it € V(V) be such that ir(x) > for any x £ V. There exists a 
decreasing function ip v : (0, 1) — ¥ (0, +oo) such that lim s j,o ipw{s) = +oo and 

^ 7r(x) ip^(ir(x)) < +oo. 

x£V 

Proof. By choosing a suitable order in V , it is enough to prove the lemma when 
V = N and n is decreasing, i.e. n(k + 1) < 7r(fc), k e N. Let us first observe 
that there exists a positive increasing sequence o 7r (fc) such that limfea 7r (fc) = +oo 
and J^k a 7r(^) < +oo. Indeed, it is simple to check that the explicit choice 

a-7r(k) = Rk + y/ Rk+i\ , where Rk '■= X^fc ""CO) meets the above requirements. 
By setting 

"07i-( s ) := SU P {fl7r(fc) , k : ?r(fc) > s} 
we then conclude the proof. □ 

Proof of Proposition \3. 7\ We prove first the exponential tightness of the empirical 
measure. Let ir be the invariant measure of the chain, tp n be the function provided 
by Lemma |3T%1 and a := J2 X n ( x )i : TT( 7T ( x )) < +oo. We define v: V — > (0, +oo) as 

i>(x) := log , x € V . 

a 

Then, in view of Lemma 13.81 v has compact level sets and (n, e u ) = 1. 

By the proof of Proposition 13.61 it is enough to show the following bound. For 
each x £ V there exist constants A, C x > such that for any T > 

x (e XT{ ^' v) ) <C X . (3.8) 

We now proceed using spectral estimates. When sup^gy r(x) < +oo the tools used 
below arc discussed in [25] App. 1, Sec. 7]. We drop this boundedness assumption 
and proceed formally. In Appendix [X] we give a rigorous derivation of our bounds, 
covering the case sup^gy r(x) = +oo. By the Feynman-Kac formula, 



3 



3 



( e XT^)\ < l E J e xf T dtv { x t )\ < 1 exp r Ts upspec{5 + Aai 
V / nix) V / nix) 



n(x) V / n(x) 

where we recall S = (C + C*)/2 and we used |25[ App. 1, Lemma 7.2] in the last 
step. The operator S + A v is understood as a self-adjoint operator in L 2 (V, ir). By 
the variational characterization of the maximal eigenvalue of sclf-adjoint operators, 

sup spec [S 1 + A w} 

sup {-£>,(/) +Att(/V)} 

= sup {-D n {^/^) + \(^v)} . (3.9) 



14 



L. BERTINL A. FAGGIONATO, AND D. GABRIELLI 



The last equality in ()3.9|) states that we can restrict the supremum to non nega- 
tive functions. The validity of the inequality > among the second and the third 
term in (|3.9I) is immediate. The validity of the converse inequality follows eas- 
ily by the inequality D 7T (f) > D„(\f\). Recalling the basic entropy inequality 
v) < log (ir, e u ) +Ent(^|7r) and choosing A G (0, 1/cls]i the logarithmic Sobolcv 
inequality (|2.9j) now implies 

supspec {S + Au} < Alog (tt, e v ) = 

which concludes the proof of (|3.8|) . 

To prove the second statement, one can proceed as in the proof of (|3.6p in Propo- 
sition [3]6] (under Condition I2.2[) . Indeed, that proof is based on the exponential 
bounds given by (|3.4[) in Lemma [3.51 The first bound corresponds here to (|3.8p . 
The same arguments used to derive (|3.8j) and item (ii) in Condition 12.31 imply the 
exponential bound (|3.8[) with v replaced by r. □ 

We conclude with a simple observation on the stationary flow: 

Lemma 3.9. Assume at least one between Conditions \2.2\ and \2.3\ to hold. Then 
(•7T,r) < +oo, equivalently Q 71 G L\_{E). 

Proof. The thesis is trivially true under Condition 12.31 Let us assume Condition 
OH By Lemma EU we have E K (e T<T<AIT ' r> ) < e TC C x /c. We restrict to V infinite, 
the finite case being obvious. Enumerating the points in V as {x n } n >o, by the 
crgodic theorem (|2.2p fixed N there exists a time To = Tq(N) > and a Borel set 
A C D(R+;V) such that (i) V X {A) > 1/2 and (ii) fx T (x n ) > ir(x n )/2 for all T > T 
and n < N P^-a.s. on A. Hence, for all T > T it holds 

e TaJ2^(x n )r(x n )/2 /2 < ^ ^Ta ££L ^(*»)r(» B ) . ^ < ^ (gT^.r) ) < e^^/^ 

This implies that Xi^Lo 7r ( a; ™) r ( :c ™) — 2C/cr. To conclude it is enough to take the 
limit N -> +oo. □ 

4. Structure of divergenceless flows in 

In this section we show that any divergenceless flow in L^(E), and more in 
general any divergenceless flow in with zero flux towards infinity, can be written 
as superposition of flows along self avoiding finite cycles. See [21] for other problems 
related to cyclic decompositions of divergenceless flows on graphs and [34] for similar 
decompositions for divergenceless vector valued measures on M. d . 

We first introduce some key graphical structures. A finite cycle C in the oriented 
graph (V,E) is a sequence (xi, . . . ,Xk) of elements of V such that (3^,3^+1) G E 
when i = 1, . . . , ft and the sum in the indices is modulo k. A finite cycle is self 
avoiding if for i 7^ j it holds Xi 7^ Xj. Given (x,y) G E, if there exists an index 
i = l,...,fc such that (x,y) = {xi,Xi+i) we write (x, y) G C. Similarly, given 
x G V, if there exists an index i = 1, . . . , fc such that x = Xi we say that x G C. 
The collection of all the self avoiding finite cycles in (V, E) is a countable set which 
we denote by C. In the sequel we shall mostly regard elements C G C as finite 
subsets of E and denote by \C\ the corresponding cardinality. Consider an invading 
sequence V n /~ V of finite subsets V n . This means a sequence such that \V n \ < +00, 
V n C V n +i and moreover U n V n = V. For any fixed n we define 

E n := {(y,z) G E : y,z G V n ] , (4.1) 



LDP OF THE EMPIRICAL FLOW 



15 



and observe that it is an invading sequence of edges. Given a flow Q G R+, we 
define 

E(Q):={(y,z)€E : Q(y,z)>0}, (4.2) 
M n (Q):= max Q(y,z), (4.3) 

ti(Q)--= E ^V,z), (4.4) 

y£V n ,zgV„ 

KiQ)~ E ( 4 - 5 ) 

y<ZV n ,z£V n 

Moreover, we say that Q has zero flux towards infinity if there exists an invading 
sequence V n /" V of finite subsets F ra such that 

lim 0+(Q) = O. (4.6) 

n— >+oo 

We say that Q admits a cyclic decomposition if there are constants Q(C) > 0, 
C eC such that 

Q=EQ(C)lc (4.7) 

CGC 

Namely, for each (y, z) e E it holds Q(y, z) = X^cec cafe *) Q(C)- We emphasize 
that the constants Q(C), C £ C, are not uniquely determined by the flow Q. 

Lemma 4.1. Le£ Q € 6e a /Zow having zero flux towards infinity and such 
that divQ = 0. Then Q admits a cyclic decomposition (|4.7p . In particular, any 
divergenceless flow Q £ L^(E) has a cyclic decomposition. 

Proof. Since (|4.6|) holds for any invading sequence of vertices if Q G L\(E), the 
second statement follows directly from the former on which we concentrate. 

On a finite graph any divergence free flow admits a cyclic decomposition. The 
proof follows classical arguments (see e.g. [2TJ[29]). If Q has finite support, i.e. if 
|-E(Q)| < +oo, the thesis follows directly by the analogous result on finite graphs. 
We will then consider only the case of infinite support, using below the result in 
the finite case. Remember that V n is the invading sequence satisfying (14. 61) . 

We assume |-E(Q)| = +oo and divQ = 0. Due to the zero divergence condition, 
a discrete version of the Gauss theorem guarantees that </>^(Q) = (j)~(Q). We define 
by an iterative procedure a sequence of flows Q l , i > 0, with infinite support and 
having zero flux towards infinity as follows. We set Q° := Q and explain how to 
define Q i+1 knowing Q\ First, we define n t := inf {n G N : M n (Q*) > (ptiQ*)}- 
Since Q % ^ 0, it must be n,; < +oo. Indeed, 0+(<3 4 ) is a sequence in n converging 
to zero, while M n (Q l ) is a non decreasing sequence not identically zero. Let g be a 
ghost site and define the flow Q l g on a finite graph having vertices V ni U {g} as 



Q\{y,z) 
Q l g (y,g) 
Ql(g,y) 



= Q i {y,z), (y,z)€E nt 

^J2 z ^v n .Q l ( z ^y) , ytv ni 



Roughly speaking, the flow Q l g is obtained from Q % by collapsing all vertices outside 
V ni into a single vertex, called g. By construction we have div Q g = 0. Calling . 
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the collection of self avoiding cycles of the finite graph and using the validity of the 
cyclic decomposition in the finite case, we have 



We claim that in the decomposition (|4.8[) there exists a self avoiding cycle Cj not 
visiting the ghost site g and such that Q g (Ci) > 0. Let us suppose by contradiction 
that our claim is false and let (x*,y*) € E ni be such that Q l (x*,y*) = M ni (Q l ). 
Then we have 

M ni (Q i ) = Q i (x*,y*)= J2 Qi(C)l {x ., y . )e c< £ Q g (C) = <(Q l ) . 

The last equality follows by the fact that any cycle with positive weight in C£ . has 
to contain necessarily the ghost site g. This contradicts the definition of n*, thus 
proving our claim. 

At this point, we know that there exists a self avoiding cycle C, := (sci, . . . , Xk) 
such that Xj € V ni and Q l (xj, Xj+\) > for any j (the sum in the indices is modulo 
k). We fix rnj := minj = i f t Q t (xj,Xj+i) and define 

i 

Q l+1 := Q* - m t lc, =Q~J2 m J lc * ■ 

3=0 

With this definition we have that Q l+1 is still a flow in R^, it satisfies div Q l+1 = 0, 
it has zero flux towards infinity and infinite support. Moreover 

\E ni n E{Q l+1 )\ < \E ni n E(Q l )\ - 1 . (4.9) 

Condition (|4.9[) implies that lim^+oo Uj = +oo. Hence, fixed any (y, z) £ E, for i 
large it holds 

Q l (y,z) < Mn^Q 1 ) < <_ 1 (Q l ) < 4>t-AQ) (4-10) 

(for the first inequality note that (y, z) £ E ni -\ for i large, for the second one use 
the definition of ni, for the third one observe that by construction Q l < Q). 

Since the r.h.s. of (|4.10[) converges to zero when i diverges we obtain lim^+oo Q l (y, z) 
for any (y,z) £ E. Finally we get 



. lim (Q(y, z)-Y" m ^c 3 (V, z)) = . lim Q i+1 (y, z) = . 

j=0 

The above limit trivially implies that Q = X)j°=o m i ■ D 

Remark 4.2. It is easy to see that Lemma \4-l\ remains valid if the condition of 
zero flux towards infinity is satisfied just by the reduced flow q G R.+ defined as 



q(y,z) ■-- 



Q{y,z) {z,y)^E, 

Q{y, z ) - min {Qiv, z ), <90, y)} {z, y) e E. 



Given an oriented graph (V, £) with countable V, £ we say that it is connected if 
for any y, z € V there exist x\, . . . ,x n such that x\ = y, x n = z and (xi, Xi+i) € £, 
i = 1, . . . ,n — 1. To every oriented graph we can associate an unoricnted graph 
(V, £ w ) for which {y,z} <G £ u if at least one among (y,z) and (z,y) belongs to £. 
We say that the unoriented graph (V, £ u ) is connected if for any y, z € V there exist 
xi, . . . , x n such that x\ = y, x n = z and {xj, Xi+i} € £ u , i = 1, . . . ,n — 1. 
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The following lemma will be useful. 

Lemma 4.3. Let (V, £) be an oriented graph with countable V,£ such that there 
exists a flow Q £ L\{£) with Q(y, z) > for any (y, z) £ £ and div Q = 0. In this 
case (V, £ ) is connected if and only if (V,£ u ) is connected. 

Proof. Trivially if the oriented graph is connected then also the unoriented one is 
connected. We prove the converse implication. Assume that (V 7 £ u ) is connected 
and suppose by contradiction that V y is strictly included in V for some y, V v being 
the set of vertices that can be reached from y by oriented paths. Note that V y is 
nonempty since y £ V y . Given A, B C V we set Q(A, B) := £\ b)<aEn(AxB) Q( a > 
Since Q is divergenceless and Q £ L+{£) (and therefore in the following sums the 
summation order can be arbitrarily chosen), it holds 

o = Y div Q(v) = Q( v \ yy ' v ) - <2( v > v \ yy ) = Q( v \ yy > vv ) - Q( yy > v \ yy ) ■ 

We point out that Q(V V , V \ V v ) = since the definition of V v implies that v £ 
V v if u £ V y . v £ V and (u,v) £ E. To get a contradiction we can show that 
Q(V \ V y , V y ) > 0. Since Q is positive, we only need to show that there exists 
a oriented bond (u,v) £ E such that u £" V v and v £ V y . Here we use that the 
unoriented graph is connected. Indeed, the nonempty set V y is connected to its 
complement V \ V v in the unoriented graph. Hence there exist u £ V y and v £ V y 
such that (u, v) £ £ or (v,u) £ £. The case (v,u) £ £ cannot take place by 
definition of V y . □ 



We can now give the proof of Proposition 12.6 



Proof of Provosition \2.m From the definition of I(fi,Q) and $ we trivially have 
that Q{y,z) > implies fi(y)r(y,z) > and therefore y £ supp(/x). Suppose by 
contradiction that z ^ supp(^). Then there would be a nonzero ingoing flow at z 
and therefore a nonzero outgoing flow at z (since /(/i, Q) < +oo implies div Q = 0). 
As a consequence there must exist an edge (z,u) £ E such that Q(z,u) > 0. As 
proven at the beginning, this implies that z £ supp(/i), hence a contradiction. This 
completes the proof of Item (i). Item (iii) is an immediate consequence of Lemma 
4.31 It remains to prove Item (ii). To this aim we first observe that divQj = 0. 
Indeed, the following property (P) holds: given y £ V we have that z belongs to 
the same oriented connected component of y if Q(y, z) > or Q(z, y) > (apply 
Item (iii)). This property and the zero divergence of Q imply that div Qj = and 
that, by definition (|2.1ip and Remark l2~4l 



I(jij,Qi)= Yl <b{Q 3 (y,z),Q»{y lZ ))+ Y, Q H (V> Z ) 



Always property (P) implies that 



(4.11) 



I(»,Q) = Y{ E HQ(y,z),Q' i (y,z))+ Y 

(4.12) 

To conclude compare (j4.11[) with (|4.12[) using that Q(y,z) = fi(K j)Q j(y , z) and 
Q»(y, z) = n{Kj)Q^ (y, z) if (y, z) £ E with y£V r □ 
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4.1. An approximation result for the function I(/j,,Q). Let S be the subset 
of V(V) x L+(E) given by the elements (fi, Q) with Q) < +00 and such that 
the graph (supp(/x), E(Q)) is finite and connected. 

Proposition 4.4. Fix (fx, Q) G V(V)xL]_(E). There exists a sequence {(fin, Qn)} C 
S such that (n n ,Q n ) — > (n,Q) in V(V) x L\{E) and 

Em" I(f-ln,Qn)<I(»,Q). (4.13) 

n— >+oo 

As proven below, the convergence (fi n , Q n ) — >■ (/i, Q) in T'(V) x Li_(.E) holds also 
with L\{E) endowed of the L 1 — norm (strong topology). 

Proof. We consider only elements {n,Q) such that I(n,Q) < +00, otherwise the 
thesis is trivially true. In particular, it must be div Q = 0. First we show that S is 
/-dense in the set S* of elements (fJ,,Q) G V(V) x L\(E) with finite support (i.e. 
with finite supp(/x) and E(Q)) and div Q = 0. Then we show that S* is /-dense in 
the set of elements (p, Q) G x L\{E) with div Q = 0. 

Let (n,Q) G 5* and denote by K\, ...,K n the connected components of the 
graph (supp(/i), Q) (recall Proposition ^. 6[) . Since (V, is connected, for any pair 
of components (Ki, Kj) we can fix an oriented path ji j on E going from Ki to Kj. 
Let respectively V and E be the vertices and the edges belonging to some path 7,j-. 
We consider the finite connected oriented graph (supp(//) U V, E(Q) U E). On this 
graph we define an irreducible Markov chain having unitary rate associated to each 
oriented edge in E(Q)UE, i.e. the rate for a jump from y to z is t((y, z) G E(Q)UE). 
We call 7r* its unique invariant measure. Then (tt*,Q*) G <S, where Q* is defined 
as Q*(y,z) = n*(y) if (y,z) G E(Q) U £'(7) and zero otherwise. Consequently for 
any e > e(7r*, Q*) + (1 — e)(^i, Q) is an element of 5 converging to (/i, Q) when 
e — > (even with £+(-5) endowed of the strong topology). Since in the case of 
finite support / can be written as a finite sum it is not difficult to show that 

lim l /(e(7r*, Q*) + (1 - e)(ji, Q)) = /(//, Q) . 

We now show that S* is /-dense in the set of elements (n,Q) G V(V) x L\{E) 
with divQ = 0. To this aim, we fix (n, Q) with divQ = and I{n,Q) < +00. By 
Lemma |4*TT1 the cyclic decomposition (|4.7[) of Q holds. We fix an invading sequence 
V n /* V of finite subsets and call E n the edges in E connecting vertices in V n (recall 
(|4.ip ). Finally, we construct the sequence (fJ. n ,Qn) G S* by 

^ :=J 7FT' Qn:= E Q( c ') I c ■ 

^ (Vn) {cec-.ccE n } 

For n large fi(V n ) > and the definition is well posed. Clearly (fj, n , Q n ) converges to 
(n, Q) (also considering the strong topology of L\(E)). It remains to show (|4. 13|) . 
By construction divQ„ = and (fx n ,r) < +00, hence, recalling p. ill) . 



E 

y£V n zeV:(y,z)eE 



J(Mn,Q»)= E ^{Qn(y,z),Q^(y,z)). 



We claim that $(Q„(y, z),Q >lrl (y, z)) = if (y,z) is as in the above sum and 
<5 /i ™(y, z) = 0. Indeed, since y G V„ it must be Q^(y,z) = 0. Since I(p,Q) < +00 
it must then be Q(y, z) = 0, and therefore Q n {y, z) = 0, thus leading to our claim. 
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To treat the general case we proceed as follows. Recall the definition of <I> given 
in (|2.10j) . Given < q' < q and p' > p > 0, let a, j3 > be respectively defined by 
q' = q(l — a) and p' = p(\ + f3). Then we have 

$(q',p') - <%, p)=q'( log t - log *) + (q' - q) log £ + (q - q') + (p' - p) 
V p' p) p 

< (q' - q) log - + (q-q') + (p' - p) = -a $(q,p) + (a + p)p < (a + p)p. 
P 

By construction, it holds fx n (y) > fi{y) for y £ V„ and Q n {y, z ) < Q{y, z ) f° r 
(y,z) € E n . Therefore, by letting f3 n := _ 1 an d a n '■ E n -> [0,1] be 

defined by Q n (y, z) = Q(y, z) [l — a n (y, z)] when (y, z) £ E(Q) we obtain 

I(Vn,Qn) < I(ji,Q)+ ^2 [p n + a„(y,z)] fx(y)r(y,z). 

y&V n zeV:(y,z)eE 

Above we used our previous claim. If I(u., Q) < +oo then it necessarily holds 
(/U,r) < +oo. We can therefore assume that n{y)r(y, z), (y,z) £ E, is summablc. 
Since /3 n ,a n (y, z) \, and the maps a n (-) arc uniformly bounded, by dominated 
convergence we conclude the proof. □ 

5. Direct proof of Theorem 12.51 

In this section we give a direct proof of Theorem [531 independent from the LDP 
for the empirical process. As already mentioned, the proof works only under an 
additional condition that we assume here: each vertex in V is the extreme of only 
a Unite family of edges in E. This assumption implies that, given <j> £ Cq(V), the 
function : E — >• K defined as V(j){y,z) — <f>(y) — <p(z) belongs to Cq(E). As a 
consequence, the map 

L\{E) 3 Q ^ (<f>, div Q) = -(V</>, Q>£l (5.1) 

is continuous. Since a linear functional on L+(E) is continuous w.r.t. the bounded 
weak* topology if and only if it is continuous w.r.t. the weak* topology [35], by 
definition of weak* topology the map defined in (|5.ip is continuous (w.r.t. the 
bounded weak* topology) if and only if V</> £ Cq(E). Hence, our additional con- 
dition is equivalent to the fact that (|5.ip is continuous for any <j> £ Cq(V). An 
explicit example where (|5.1j) becomes not continuous for <p = Ix, x £ V , is given in 
Appendix [Cj 

5.1. Upper bound. Given <p £ Co(V) and F £ C C {E) (i.e. <j) vanishes at infinity 
and F is nonzero only on a finite set) let Icj>,F'- "P(V) x L l + (E) — > R be the map 
defined by 

I^pQi, Q) := (0, div Q) + (Q, F) - (ji, r F - r) (5.2) 
where r F : V —> (0, +oo) is defined by r F (y) = J2 zeV r(y, z)e F ^ v,z " 1 and (cj), div Q) = 

Ttyev&iv) div( 3(y)- 

Lemma 5.1. Fix x £ V. For each <j) £ Cq(V), F £ C C {E), and each measurable 
B C V(V) x L\(E), it holds 

EE ^logP* ((mt,Qt) e B) < - inf If, F (ji,Q). 

T— >+oo 1 \ / (n,,Q)eB 
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Proof. Fix x £ V and observe that the following pathwise continuity equation holds 
P x a.s. 

6 y (X T )-5 y (X )+TdivQ T (y) = Q Vy e V. (5.3) 

Fix F £ C C (E) and <fi G Co(V) and recall the semimartingalc M F introduced in 
Lemma 13.11 In view of (|5.2|) and (|5 . 3f) , for each T > and each measurable set 

ec?(^) x L\{E) 
P*((Mt,Qt) 6 6) 

= E I (exp{ -TI^fOmt,Qt)- [<f>(X T ) - 0(a)] } M£ I b 0*t,Qt)) 
< sup e- T/ *^^ Ejcxpj - [0(X r )-0(a:)]}M?lBO*r,QT)). 

Since is bounded, the proof is now achieved by using Lemma 13. II □ 

We can conclude the proof of the upper bound in Theorem 12.51 In view of the 
exponential tightness proven in Subsection 13.21 it is enough to prove (|2.12p for 
compacts. By our additional assumption, we get that the map I^ t p is continuous. 

Fix x £ V. By Lemma 15.11 and the min-max lemma in |25l App. 2, Lemma 3.3] 
for each compact K C V(V) x L\{E) it holds 

lim ^-\ogV J{^ t ,Qt) G/C) < - inf sup I^ F (p,Q) 

where the supremum is carried out over all <f> £ Cq{V) and F £ C C (E). Recalling 
(|2.1ip , it is now simple to check (see Appendix |B|) that for each (fi,Q) £ V(V) x 
L\(E) it holds 

Q) = sup I^fUi, Q) , (5.4) 

cf>,F 

which concludes the proof of the upper bound. 

Trivially, the function 1$ p can be thought of as the restriction to V(V) x L\(E) 
of a continuous linear function defined on WL V x L 1 (i?) where M. v has the product 
topology. This observation and (|5.4[) imply the convexity and lower semicontinuity 
of/. 

5.2. Lower bound. Recall the following general result concerning the large devi- 
ation lower bound. 

Lemma 5.2. Let {P n } be a sequence of probability measures on a completely reg- 
ular topological space X . Assume that for each x £ X there exists a sequence of 
probability measures {P£} weakly convergent to S x and such that 

lim -Ent (P%\P n ) < J(x) (5.5) 

for some J: X — > [0, +oo]. Then the sequence {P n } satisfies the large deviation 
lower bound with rate function given by sc~ J, the lower semicontinuous envelope 
of J, i.e. 

(sc~J) (a;) := sup inf J(y) 
where M x denotes the collection of the open neighborhoods of x. 
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This lemma has been originally proven in [23l Prop. 4.1] in a Polish space setting. 
The proof given in [30l Prop. 1.2.4] applies also to the present setting of a completely 
regular topological space. 

Recall the definition of the set S given before Proposition 14.41 S is given by 
the elements (fi,Q) 6 ~P(V) x L\_{E) with I(ji,Q) < +oc and such that the graph 
(supp(/i), E(Q)) is finite and connected. 

First we prove the entropy bound (|5.5|) with J given by the restriction of /, as 
defined in (|2.11[) . to S : that is 

J(M,Q) ■= < . (5.6) 

I +oo otherwise. 

Then we complete the proof of the lower bound (|2.13j) by showing that the lower 
semicontinuous envelope of J coincides with /. 

Lemma 5.3. Fix x £ V and set Pt := P^ o (iittQt) 1 - For each (fi,Q) E S 
there exists a sequence {Pyf'™} of probability measures on V(V) x L+(E) weakly 
convergent to <5( Mi q) and such that 

Bm iEnt(P^ Q) |P T )</( M ,Q). 

Proof. First we discuss the case when x £ K := supp(/i). We denote by Pi M '^ the 
distribution of the Markov chain £ x on V starting from a; and having jump rates 

I otherwise. 

Observe that this perturbed chain can be thought of as an irriducible chain on 
the finite state space K. Moreover, the condition div Q = implies that [i is the 
invariant probability measure. 

Set P^ Q) := fi" Q) o (n T ,Q T )~ X - The ergodic theorem for finite state Markov 
chains and the law of large numbers for the empirical flow discussed in Section 12.11 
imply that {P^ Q) } converges weakly to 5(^,q)- A straightforward computation of 
the Radon- Nikodym density (recall (|3.ip ) yields 

iEnt(i*»'«>|ft.) < iEnt(i^9)| M P.| Mj 

- E ^(*<*'>*^^-«<»>[^-'M) 

(5.8) 

where the subscript [0,T] denotes the restriction to the interval [0, T] (above we 
used the convention OlogO := 0). 

Since TE X ^ Q) (Q T {y, z)) = E X ^ Q) ((/i T , r)) (adapt (2j| to the present setting) 

and since Ht{u) Paf — a.s. by ergodicity, the r.h.s. of (|5.8|) converges in 

the limit T — > +oo to 

£ (Q(y, z) log Q( J' Z) r +/x(y)r(y, z) - Q(y, zj) + £ M (y) ]T r(y, z) , 
that is /(/i, Q). 
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When x K then there exists an oriented path on (V, E) from x to K since 
(V, E) is connected. In this case the perturbed Markov chain £ x is defined with 
rates (|5 . T[) with exception that f{y, z) := r(y, z) for any (y, z) belonging to the 
oriented path from x to K (fixed once for all). Since after a finite number of jumps 
that Markov chain reach the component K . it is easy conclude the proof by the 
same computations as before. □ 

Recall (|2.1ip and (|5.6[) . As already noted, the variational characterization (|5.4|) 
implies that / is lower scmicontinuous and convex on V(V)xL\(E). In particular, 
the inequality sc~ J > / holds. The proof of the equality / = sc~ J is therefore 
completed by Proposition 14.41 



6. Projection from the empirical process: proof of Theorems 12.51 12781 

We recall the definition of the empirical process referring to |17|-(IV). |37j for 
more details. We consider the space D(R; V) endowed of the Skorohod topology 
and write X for a generic element of D(R; V). Given X £ D(R+; V) and t > 0, the 
path X 1 £ D(R; V) is defined by 

\xl := X s for < s < t, 
\Xl +t :=X*for S eR. 

Writing Ms for the space of stationary probabilities on D(R; V) endowed of the 
weak topology, given X £ -D(R+; V) and t > we denote by 1Zt,x the element in 
Ms such that 



1 r* 

(A) = - XAiOsX^ds, VA c D(R; V) Borel, 
* JO 



where (9 s X t ) u := X l s+U . Since X — > TZ t ,x is a Borel map from -D(K+; V) to Ms, for 
each x e V it induces a probability measure T t . x on Ms defined as T t . x '■= ^x°T^x- 
The above distribution T ttX corresponds to the i-periodized empirical process. 

Let us denote by R the stationary process in Ms associated to the Markov chain 
£ and having 7r as marginal distribution. By the ergodic theorem (|2.2[) . Y t , x weakly 
converges to 6% as t — > +oo, for each x £ V. As proven in [H]-(IV), under the 
Donsker-Varadhan condition, for each x £ V as t — > +oo the family of probability 
measures T^ x satisfies a LDP with rate t and rate function the density of relative 
entropy H w.r.t. the Markov chain £. 

We briefly recall the definition of H and some of its properties, referring to 
[T7]-(IV) for more details. Given — oo < s < t < oo, let be the cr-algebra in 
D(R;V) generated by the functions (X r ) s < r < t . Let R £ Ms and i?o,x be the 
regular conditional probability distribution of R given J^q 00 , evaluated on the path 
X. Then H(R) £ [0,oo] is the only constant such that H(t,R) = tH(R) for all 
t > 0, where 

H(t, R) := E R [fT^j (R^x \ P Xo )] , (6.1) 

Hjro(Ro^x I Pjf ) being the relative entropy of Ro,x w.r.t. Px thought of as prob- 
ability measures on the measure space D(R; V) with measurable sets varying in 
the cr-subalgebra . The entropy H(R) can be also characterized as the limit 
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H(R) = linit^oo H(t,R)/t, where 

H(t,R):= sup [E«( V )-E Jl (logEx (e*'))] (6.2) 

and B(J^) denotes the family of bounded J-^-measurable functions on D(M.;V). 
Below we will frequently use that 

tH(R) = H(t, R) > H(t, R) = sup E R ((p) , (6.3) 

¥>€Yi(i) 

where Yi(t) is the family of functions <p € such that E a; (e' /3 ) < 1 for all x G V 

(the last identity is an immediate restatement of (|6.2|) ). 

In the following proposition we investigate some key identities concerning the 
map R — > (jj,(R), Q(R)). Recall the definition of Q(R) given before Lemma \2. 71 

Proposition 6.1. Assume the Markov chain satisfies (A1)-(A4). Thenj2CR,T,x) = 
Hr(X) andQ(K T ,x) = Qt{X t ) € L\{B) for¥ x -a.a. X e D(R + ;V). 

Proof. The fact that 'P(TZt,x) — Ht(X) P^-a.s. has already been observed in |17j- 
(IV). Let us prove that Q(1Zt,x) = Qt(X t ) P x -a.s. It is convenient to introduce 
the following notation: given (y,z) G B, X G D(R + ;V) and / C M+ we write 
Ni(y, z)(X) for the number of jumps along (y,z) performed by the path X at 
some time in /. In addition we write Nx{y, z)(X) for -/V[ 0j T](y, Z )(X). Equivalently, 
N T (y,z)(X) = TQ T (y,z)(X). Given T > we fix a value a G (0,T). Then we 
have 

Q(y,z)(K T , x ) = ^En T , x (N a (y, z)) = f N a (y, z){O s X T )ds 



= ^ £ ' N [s , s+a] (y,z)(X T )ds. 



Let us write < ti < t-2 < ■ ■ ■ < t n < T for the times in [0, T] at which the path X T 
jumps from y to z. Note that n = N T (y,z)(X T ). We denote by tt t : R -> R/TZ 
the canonical projection of R on the circle of length T. It maps bijectively [0, T) on 
R/TZ. Moreover, we define the set 6 T (y, ^)(^ T ) := {ttt^i), 7r r (*2), • ■ ■ , 7r T (*«)}• 
Since T > a the number A^r SiS _|_ a i (y, z)(X T ) of jumps from y to z made by X T in the 
time interval [s, s + a] coincides with the cardinality of Qt(v, z )(X t ) P\itt([s, s + a\). 
Hence 

Q(y,z)(K T ,x) J q \QT(y,z)(X T )nir T ([s,s + a})\ ds = 

ri(^fc)eM[v + «]))rf^E^=Qr(^)(^). (6.4) 
fe=i a ^° fe=i 

□ 

Note that, since P^-a.s. time T is not a jump time, it holds 
T (y,z)(X) + ± ifX T _=y,X 




<y,z)(X')= r ; T ~' P x -a.s. (6.5) 

-(y,z)(A) otherwise, 



In what follows, in order to allow a better overview of the proof of Theorems [23 
and !2.8| we focus on the main steps, postponing some technical details in subsequent 
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sections. We start with Theorem 12.81 since the product topology on the flow space 
is simpler. 

6.1. Proof of Theorem 12.81 The proof is based on the generalized contraction 
principle related to the concept of exponential approximation discussed in |15j . To 
this aim, given e £ (0, 1/2), we fix a continuous function Lp £ : R — > [0, 1] such that 
<p e (x) = if x $ (0,1) and <p £ (x) = 1 if x £ [e, 1 — e\. For each (y,z) £ B we 
consider the continuous and bounded function Fy z : D(M.; V) — > M. defined as 

F^ Z (X):={ ]T ^(s)l{X s _=y, X s = z)} As' 1 . 

sS[0,l] 

Then, we define Q £ : Ms -> [0,+oo] B as Q £ {y,z){R) := E R (F^ Z ). Note that Q £ 
maps Ms into [0,e _1 ] B . 

Proposition 6.2. Assume the Markov chain satisfies (Al)-(A4). Consider the 
space [0, +oo] B endowed of the product topology and the Borel a-algebra. Then the 
following holds: 

(i) The map (fi,Q) : Ms — > "P(V) x [0, +oo] B is measurable and the map 
ju : Ms ViV) is continuous. 

(ii) The maps Q e : Ms — > [0, +oo] s , parameterized by e £ (0, 1/2), are contin- 
uous and satisfy 

lim sup \Q(y,z)(R)-Q £ {y,z){R)\=0, (6.6) 

e -l- RGMs ■ H(R)<a 

lim lim ^\ogT T ^ (\Q(y, z) - Q £ {y, z)\ > s) = -oo , (6.7) 
/or any x £ V , a > 0, 5 > and any 6ond (y, z) £ B. 

As shown below, if H{R) < +oo then Q(R) £ R+. In addition Q £ always 
assumes finite values. In particular, the quantities appearing in (|6.6[) and (|6.7p arc 
finite and the subtraction is meaningful. We postpone the proof of Proposition 16.21 
to Section [7] and conclude the proof of Theorem 12.81 

To prove item (i) up to (|2.15p we apply Theorem 4.2.23 in [T5]. Identity (16. CP 
corresponds to formula (4.2.24) there, while identity (|6.7p states that the family of 

probability measures |rr, x o (jj,, Q^ 1 1 is an exponentially good approximation of 

the family |lY , x ° (a*j Q) 1 }• Combining the last observations with the LDP of the 
empirical process proved in [17]~(IV), one gets the thesis for the family of probability 
measures {P^ o {ht^Qt)" 1 } on V{V) x [0,+oo] B where Qt{X) := Qt(X t ) (use 
Proposition ^. ip . At this point, due to Theorem 4.2.13 in [15], we only need to prove 
that the families of probability measures {P^ o (/i T , Qt) -1 } and {P^ o (ht, Qt) 1 } 
are exponentially equivalent. It is enough to show that for each 6 > it holds 

Em" ^logF x (D(Q T ,Q T )>S) = -oo, (6.8) 

T— ¥ + 00 1 

where D(-, •) denotes the metric of [0, +oo] B introduced at the beginning of Subsec- 
tion By (|6.5p Qr(y, z) = Qr(y, z) with exception of at most one random bond 
and in this case Qr(y, z) = Q T {y,z)+l/T. Since |o/(l+o)-(o+A)/(l+a+A)| < A 
for a, A > 0, we conclude that D(Qt, Qt) < thus allowing to end the proof. 
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6.2. Proof of (|2?L6]) . 

6.2.1. Proof of (f2A6|) /or Q g Rf . Wc distinguish two cases: Q(y,z) G (0, +oo] 
for some (y, z) G B\E and Q(y, z) = +oo for some (y, z) G E. In the first case we 
take the function ip(X) := Xl{Q T {y,z) > 0) for fixed A > 0. Trivially, <p £ *i(T). 
Hence by (|6.3|) we get 

TH(R) > H(T, R) > E R (ip) = XR (Q T (y, z) > 0) . 

Since the last probability is positive, the thesis H(R) = +oo follows by taking A 
arbitrarily large. 

Let us now consider the second case. By Remark 12.11 (stochastic domination), 
it holds C := sup x£V E x (e9 T ( y ' z ^ < +oo . Hence, the proof in the second case is 
similar to the one in the first case taking <p := Qr{y, z)I(Qt(2/, z) < A) — log C and 
A > arbitrarily large. 

6.2.2. Proof that I(p,Q) < I(fi,Q) for (ji,Q) G V{V) x L\{E). 
Lemma 6.3. Given R G Ms with Q = Q(R) G Rf , it holds 

z:(y,z)£E z:(z,y)eE 

Proof. The thesis follows by considering the i?-expectation of the following identity 
on£>([0,T];V): 

l(X T = y)+ TQ T (y,z) = l(X = y)+ £ TQ T (z,y) . □ 

z:(y,z)eE z:{z,y)EE 

Fix (p,Q) G V(V) x L+(.E). By Lemma IQ1 if divQ 7^ then there is no 
R G A^s such that Q = Q(R) and therefore I(^l,Q) = +00 = I(fi,Q). Hence, 
from now on we can restrict to div Q = 0. Fix R G .Ms such that Q = Q(-R) and 
/1 = /i(-R) (the absence of such an R would imply I{fi, Q) = +00 and there would 
be nothing to prove). 

We first consider the case that there is some edge (y, z) G E with Q(y, z) > and 
/j,(y) = 0. Trivially in this case Q) = +00. Let us prove that /(/x, Q) = +00. 
To this aim, given e > 0, wc define the function F e : E — s- R as F £ (u,v) — 
log ( u 7 w) = (y, z ) )■ Let e Ve := be the supermartingale introduced in 

Lemma 13.11 

~Q(v,z) 



Ve = TQ T (y, z) log ^4 " T Vt(v) 
sr(y,z) 



r 



(y>2) 



(6.9) 



We take e small enough so that log SOmI > and define for I > the new function 
ip e j as in the r.h.s. of (|6.9|) with Qr(y, z) replaced by Qt(jj, z) Al. Then (p e ^ < (pi 
and by Lemma l3~Tl we conclude that ip Sj t G ii(T). Applying (|6.3|) wc conclude that 

> M^j)/ T = E«(Qr(l/, 2) A log ^4 ■ 

er(j/,z) 

Taking first the limit £ — > +00 and afterwards e — > 0, we get that H(R) = +00, 
thus implying /(/x, Q) = +00. 
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Due to the previous result, we restrict to the case that n{y) > if Q(y, z) > 0, 
with (y, z) G E. Then we fix an invading sequence E n E of finite subsets of E 
and consider the function F„ : E — > M. defined as 




if (y, z) G E n 
otherwise . 



fj,(y) > if Q{y, z) > 0. Let e v " := M T n be the supermartingale introduced in 



with the convention that 0/0 = 0. Note that the above ratio is well defined since 

My) > o if 

Lemma 13.11 

— ( e & - i] y 

Since ip n is unbounded, for £ > we consider the cut-off 

We stress that the sum in the definition of ip n is finite. Since \(p n .i\ < |</?n| G L l (R) 
(recall that Q = Q{R) G L\_(E)), by the Dominated Convergence Theorem it 
holds lini£_ ) ._|_ 00 E# (f n ,i) = E/j(<p„). Moreover, applying Remark 12.11 and using 
the notation introduced there, by enlarging the probability space we obtain that 
there exist positive constants A n ,B n depending only on n such that 

\<PnA X )\ ^ \<Pn(X)\ < A n Z V-z + B » 

(v,z)eE n 

sampling X by P^. This implies that logE^ {e. Vn < 1 ) is bounded uniformly in x G V 
and therefore, applying twice the Dominated Convergence Theorem we conclude 
that 

lim E R logE Xo (e^) = hm V logE, (e^) = V (i{x) \ogE x (e^») < . 

£->+oo £— S-+00 * — ' *■ — ' 



Note that the last bound follows from Lemma I3TT1 As a consequence 
lim {E fi { VnJ ) - E R logE Xo (e^- e )} > E R (<p n ) . 

I — >oo 

Combining the above estimate, (|6.2p and (|6.3|) . we conclude that 

H(R)>H(T,R)/T>E R (tp n )/T = ]T *(Q(y,*), Q"{y,z)) . (6.10) 

To conclude we take the limit n — > +oo, obtaining H(R) > 7(/x, Q) for each R G A4$ 
such that Jl(R) = yU, Q(R) = Q- This implies that I(n,Q) > I(n,Q). 

6.2.3. Proof that I(p, Q) > T(p, Q) for (fx, Q) G V(V) x L\(E). As consequence of 
the first part of Theorem 12.81 (already proved), the function / is lower semincon- 
tinuous. Consider the sequence {{^ n ,Qn)}n>o m S converging to (/x, Q) as stated 
in Proposition 14.41 The set S has been defined in Section 14.11 as the subset of 
V(V) x L\(E) given by the elements (//, Q) with Q) < +oo and such that the 
graph (supp(/i), E(Q)) is finite and connected. For each n we consider the con- 
tinuous time Markov chain £w on V with jump rates r n (y,z) = Q n (y,z)/fj, n (y) 
with the convention 0/0 = 0. Since I(fJ, n ,Qn) < +oo it cannot be Q n (y,z) > 
and Hn{y) = 0, hence the above ratio is well defined. Since /i„ and Q n have finite 
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support, the Markov chain ^ n > is indeed a Markov chain with finite effective state 
space. In particular, explosion does not take place. The bound I(fj, n ,Qn) < +00 
implies also that divQ n = 0, hence we get that fi n is an invariant measure for 
£("). We define R n as the stationary Markov chain f( n ) with marginal fi n , then 
Q(R n ) = Q n - By the Radon-Nykodim derivative (|3.1j) and the definition of the 
entropy H(-), we get that I(/J, n ,Qn) < H(R n ) = I(fj, n ,Q n ), Invoking the lower 
semicontinuity of / and Proposition 14. 4[ we get the thesis. 

6.3. Proof of (|2J7]l . Let us take (fj,,Q) with fj, £ V(V) and Q £ Rf\ L\{E). 
We need to prove that J(/x, Q) = +00. Let R £ Ms be such that fi(R) = fi and 
Q(R) = Q (we assume R exists, otherwise the thesis is trivially true). We fix an 
invading sequence V n /• V of finite sets, define E n := {(y, z) £ E : y,z £ V n } and 

F n (y,z) := l((y,z) £ E n ) for (y,z) £ E. Then we know that E x ( cxp{ My™ } \ < 1 
for all 16 V, using the same notation of Lemma |3. II Again we need to work with 
functions in B(J-j,). To this aim, given £ > we define M^K as the supermartingale 

My" except that the empirical flow Qr(y, z) is replaced by Qr{y, z)A£ for all edges 
(y,z). Then (note that r F " > r) £ B{F%) and My™ < My", thus implying 

that e Yi(T). By (JOJ) this implies that 



H(R) > H(T,R)/T > lim eJm^A/T = V Q(y,z) - E fl (// T (r F " - r)) . 

>oo \ ' / * — ' 

(6.11) 

The conclusion then follows from the next result: 

Claim 6.4. Assume Condition \2.2\ (where the constants o~,C are defined). Then 
for each R £ Ms it holds 

\\Q(R)\\ <H(R)(l + e/a) + Oe/a. (6.12) 

Proof. Let us first prove (|6.12p knowing that H(R) > E R (v(X )^ . We come back 
to (|6.11[) and take first the limit T —> +00 and afterwards the limit n — > +00. Since 
< r Fn —r<er and, by Fubini-Tonelli and stationarity, E R (fiT(r)) = E R (r(X )), 
we conclude that 

||Q|| = ||Q||= lim Q(y,z)<H(R)+eE R (r(X )). 

By Condition O E R (r(X )) < E R (v(X ))/(T + C/a. Combining with H(R) > 
E R (v(Xo)) we get the thesis. 

Let us now prove that H{R) > E r (v(Xq)) . Since both H(R) and E r (v(Xq)) are 
affine in R (see Q~Z]-(IV)) and since all stationary processes are convex combinations 
of ergodic stationary processes, it is enough to prove the claim for an ergodic 
R £ M s . Given k, T > and W C V we define := v A k and ip{X) := 1{X £ 
W) J T v ( - k \X s )ds. Trivially, ip £ B{J^). Then, by the definition of H(T, R), it 
holds 

TH(R) > H(T,R) >E R (<p) -E r (log E Xo (e^)) 

/ f T \ (6-13) 

> E R ( / v^{X s )ds;X G W) - maxlog (C x /c) . 

\J ) xdW 
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In the last inequality we have used Lemma 13.51 and the inequality < v. At this 
point, we divide (|6.13j) by T. Since R is ergodic, by BirkhofT ergodic theorem (note 
that v {k) (X ) £ L l {R) since i/ fe ' is bounded) we know that 



lira - / v {k \x s )ds = E R (v [k) {X )), R-a.s. 



Taking the limit T — > oo and applying the Dominated Convergence Theorem we 
conclude that 

H(R)>E R (v ik Hx ))R(X eW). 

At this point it is enough to take the limit k — >• oo and afterwards to take W 
arbitrarily large and invading all V. □ 

6.4. Proof of Theorem 12.51 The proof uses the results of [T5], where the notion 
of exponentially good approximation and the contraction principle are extended to 
the case of completely regular space as image space of the projection. To this aim 
we recall some further properties of the bounded weak* topology on L+(E). 

We define A as the set of sequences a = (a n ) n >i of functions in Cq(E) such that 
1 1 «n I |oo — >• 0. Given a £ A we introduce the pseudomctric d a on L^(E) as 

d a (Q, Q') ■= sup(Q - Q', a n ) . 

n>l 

Writing B a {Q 7 r) := {Q 1 £ L\{E) : d a (Q,Q') < r}, the family of sets {B a (Q,r)}, 
with a £ A, Q £ L+(E) and r > 0, form a basis for L\(E). This follows from 
Dcf. 2.7.1 and Cor. 2.7.4 in [35]. In addition, the family T> of pseudomctrics 
{d a : a £ Cq(E)} is separating, i.e. given Q ^ Q' in L\.(E) there exists a £ A 
such that d a (Q, Q') > 0. The above two properties (basis and separating family of 
pseudomctrics) make L+(E) a so called gauge space. Indeed, one can prove that 
the concepts of completely regular space and gauge space arc equivalent [T8] [Ch. 
IX]. 

Due to the above observations on the gauge structure of L\.{E) we are in the 
same settings of [TI5]. In what follows we restrict to the case |V| = +oo, thus 
implying \E\ = +oo due to the irreducibility of the Markov chain £ (the finite case 
is much simpler). Fix an enumeration (e n ) ra >i of E. Consider the maps Q,Q £ 
entering in Proposition 16.21 and define the maps Q, Q £ : Ais —> L\{E) by 



Q{R) 
Qe(R)(e n ) 



(q(R) if Q(R) £ L\{E) 
[ otherwise , 

(Q E (R)(e n ) ifn^e- 1 , 
I otherwise . 



Proposition 6.5. Assume the Markov chain satisfies (Al)-(A^) and Condition 
2. Si Consider the space L}^_(E) endowed of the bounded weak* topology and the 
Borel a -algebra. Then the following holds: 

(i) The map Q : Ais ~ * L\_(E) is measurable while the maps Q £ : Ais — > 
L+(E) are continuous. 
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(ii) For each a ^ A 

lim sup d a (Q(R),Q E {R)) = 0, (6.14) 

R£M S -H{R)<a 

limBE 7 =logr T , x (d a (Q,Q e )>S) - -oo, (6.15) 

for any x £ V, a > 0, S > 0. 
The proof is given in Section [5] 

As byproduct of Proposition 16.51 the extended contraction principle in [TO] , the 
LDP of the empirical process and Theorem I2.8l -(ii) we can conclude the proof of 
Theorem 12.51 Let us be more precise. We apply Theorem 1.13 in [TO]. Formula 
(|6.14[) corresponds to formula (1.14) in [TO], while formula (|6.15[) means that the 
family of probability measures {Lr,x ° Qe) -1 } is a (d a )ae.A _ e x Ponentially good 
approximation of the family {Ft.x ° (MjQ) -1 }- O n the other hand, we have that 
Q = Q £ L\(E) r^j-a.s., while by Proposition ^ . 1 1 the random variable Q sampled 
according to Yt,x has the same law of Qt{X) := Qt{X t ) with X £ D(R + ;V) 
sampled according to P x . Hence, by Corollary 1.10 in [TO] we only need to prove 
that the families of probability measures {P^ o (/j,t, Qt) -1 } and {P x o (/j,t, Qt) 1 } 
are (d ) og ^-exponcntially equivalent on V(V) x L\(E), It is enough to show for 
each 8 > and a £ A that 

BE ^log¥ x (d a (Q T ,Q T )>5) = -oo, (6.16) 
Since by (|6.5j) d a (QT,QT) < ||a||oo/T\ we get the thesis. 

7. Exponential approximations: Proof of Proposition HT21 

Item (i) is straightforward. We concentrate on item (ii). Since Ms is endowed 
of the weak topology and since Fy z is a continuous bounded function on D(M; V) 

we conclude that Q s is continuous. 

7.1. Proof of (|6.6[) . As already proved in the previous section (independently from 
the content of Proposition 16. 2[) . I(/j,,Q) = +oo if Q £" P^J. Hence, given R £ Ms 
with H(R) < +oo, it must be Q(y, z)(R) < oo for all (y, z) £ B and Q(y, z)(R) = 
if (y, z) £ B\E. Since Q £ (y, z) < Q(y, z), the same claim holds for Q e instead of 
Q. In particular, equation (|6.6[) is meaningful and is trivially true for (y, z) £ B\E. 
We then restrict to (y, z) £ E. Below R £ Ms is such that H(R) < a. 

Recall the definition of Nj(y, z) and N-r{y, z) given in the proof of Proposition 
16.11 We can estimate 

\Q(y,z)(R)-Q s (y,z)(R)\ 

< E H (JVi(y, z); N^y, z) > e" 1 ) + E R (N [0te]u[1 _ £il] {y, z)). (7.1) 

By stationarity (see the proof of Lemma 12.71) 

E R (N [0t£] {y,z)) =E fl (JV [1 _ e , 1] (y,z)) = eE^N^y, z)) = eQ{y,z){R). 

Consider £ £ M. + and apply (|6.3[) with t = 1 and c/5 = Ni(y, z) A £ — r(y, z)(e — 1) 
(note that </? £ Y x {t) by Remark I27T]). We get for R £ M s such that H(R) < a 

a + r(y, z)(e - 1) > H(R) + r(y, z)(e - 1) > E« (Ni{y, z) A £) . (7.2) 
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Since by the Monotone Convergence Theorem \imi-> +00 E_r (TVi (y, z) A £) = Q(y 7 z) (R) , 
taking the limit I — > +00 on both extreme sides of (|7.2|) we deduce 

a + r(y,z)(e-l)>Q(y,z)(R). 

From the above inequality we get that the last term in (|7.1[) converges uniformly 
to zero on {R G Ais '■ H(R) < a} as e J, 0. To conclude, it remains to prove that 
]im. e io^n(Ni(y, z);N\(y, z) > e -1 ) = 0. To this aim, given > we define on 
D(R] V) the function 

ip lAe := 1 N 1 {y 1 z)\{t > iVi(y.z) > e^ 1 ) - C( 7 ,e) 

where C( 7 ,e) := sup x£V \ogE x ( e lNl{v ' z} ) . Due to Remark EQ (sto- 

chastic domination), we get C(7, e) < +00 and lim e |o C( 7 ,e) = 0. By construction 
f-y,e,e G f° r t>l. Applying (|6.3p we get for t > 1 that 

Ejt(V7A*) < # (*, -R) < tH(R) < tat . 

Taking ^ — > 00, we conclude that E fi (A^i(?/,z); N^y.z) > e^ 1 ) < ta/j+C(j, e)/ 7 . 
Taking first the limit e 1 and afterwards the limit 7 f 00, we conclude that the 
expectation E#(./Vi(y, z); Ni(y, z) > e -1 ) is negligible as e I 0. □ 

7.2. Proof of (|6.7p . We restrict to T > 1 (the generic case could be treated by 
the same arguments of the proof of Proposition 16. ip . Recall the definition of the 
projection ttt and set 6r(y, Z )(X T ) given there. P^-a.s. it holds 

Q e (y,z)(K Tt x) = ^ f { Mu-s)} Ae-'ds. (7.3) 

J ° ue[s,s+l]: 

n T (u)ee T (y,z)(x T ) 

For each (y, z) £ B and e > we define the functions G e (y,z) and H e (y,z) on 
D(R; V) as 

G e (2/, z)(Jf) := i jT |0 T (y, z)(X T ) n tt t ([ S + e, s + 1 - e]) | A e^ds 

H E (y, z)(X) := i y |6 T (y, z)(X T ) n ttt([s + e, s + 1 - e])\ds . 

By the same argument used in identity (|6.4I) . it holds 

H s (y, z)(X) = (1 - 2e)Q T (y, z)(X T ) = (1 - 2e)Q(y, z)(ft T ,x) . (7.4) 

Trivially, it holds Q(y, z)(Kr,x) > Qe(y, z){Hr,x) > G £ (y,z)(X). Using (JTU) and 
the last bounds, we can estimate 

P* (Q(y, z){Ut,) - Qe(y, z){1l T ,) > 5) 
<¥ x (Q(y,z)(R T ,) - G E {y 7 z)> 5) 

< P 8 (§(y, z){Kt,) - H s (y, z) > 8/2) + T x (H e (y, z) - G e (y, z) > 8/2) 
= V x (2eQ T (y, z)(X T ) > 8/2) + ¥ x (H s (y, z) - G £ (y, z) > 8/2) . 

(7.5) 

In order to prove the super-exponential estimate (|6.7p it is enough to prove a super- 
exponential estimate for both terms in the last line of (|7.5p . 
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(2eQ T (y lZ )(X T ) > 8/2 
p(2e(Z T + l)/T>8/2^ 



Since, by the graphical construction, under P^ the process {\TQr{y, z)(X)\} TeM+ 
is dominated by a Poisson process {Zt}t£r + with parameter r(y, z) we have 

lim lim — los 

< lim lim — Ioe 

< lim — $ ( — , r(y, z" 

We used a LDP for the Poisson process (the extra 1 /T term is irrelevant) and the 
explicit form of the rate functional. 

It remains to bound the last term in (|7.5[) . For simplicity of notation we restrict 
to T integer (the general case can be treated similarly). We define ip E {r) = rJ(r > 
e _1 ). Given j = 0, 1, . . . , T — 1 and s e [j, j + 1) we have 

\QT(y,z)(X T )nir T ([ S + e,s + l-E})\ 

- |6 T (y,z)pf T )n7r T ([s + £,s + I -e}) \ Ae" 1 

<i; e (\e T (y,z)(X T )mr T ({j,j + 2))\) . 

Hence, we can estimate 

1 T_1 

H £ (y,z)(X)~G e (y lZ )(X) < -Y,iPe{\QT(y,z)(X T )mr T ([],j +2))\) . (7.6) 

3=0 

By the graphical construction of Markov chains, under P^ the set of jump times 
for a jump from y to z can be identified with a suitable subset of an homogeneous 
Poisson point process on R + with intensity r(y,z). In particular, it is possible to 
define a probability measure V on the product space D(R + ;V) x _D(M + ;N) such 
that 

(i) the marginal of V on D(R + ; V) equals P^; 

(ii) the marginal of V on D(K + ; N) is the law of a Poisson process with param- 
eter r(x, y), 

(hi) calling (X t )teR+ and (Z t )tm + the generic elements of respectively D(M. + ;V) 
and D(M+;N), it holds V-a.s. 

N [a>b] (y, z){X) <Z b -Z a , Va < b in R+ . 

Due to the above coupling and since on the interval [0, T] the paths X and X T can 
differ at most in T, we can estimate 'P-a.s. 

^ £ (\0 T (y,z)(X T )mr T ([j,j+2))\) 

< U e (Z j+ 2-Z j ) ifO<j<T-2, 
-\i> e ([Z T -Z T -i] + Z 1 + l) ifj=T-l. 

Now we introduce the nondecreasing function ip e (r) := 2rl(r > e~ 1 /2) satisfying 
the inequality ip £ {a + b) < V» E (o) + i>e{b)- Then (|7.6[) and (|7.7|) imply P-a.s. that 

T— 1 

ff £ (y, z)(X) - G B (y, «)P0 < 1 XI MZ J+1 - Zj + 1) . 

3=0 
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At this point we recall that under V the random variables ( Zj+\ — Z; ) 

\ Ja<j<T-i 

are independent Poisson random variables with parameter r(y,z). Hence we can 
estimate 

Km hm^ ^ log [v x (H e (y, z) - G e (y, z) > 5/2) 
= lim lim — log 

elO T->+oo T 



V{H s (y,z)-G s (y,z)>6/2 



< lim lim — log 



V 



2 ^~ 1 

3=0 



MZj+i - Zj + 1) > 5/2 



< lim -4(5/2) = -oo. 



(7- 



In the above chain of inequalities we used Cramer Theorem for the sum of the 
independent random variables 2-0 e (Zj + i — Zj + 1) calling I £ the associated rate 
function. The divergence in the last line follows by the following argument. Let 

A £ (A) := logE (e A2 ^ (Zl ~ z °^. By the Monotonce Convergence Theorem A E (A) 

converges to zero for each A € 1 as e goes to zero. Since the rate function I e is the 
Legendre transform of A e , we get for each fixed A £ R that 

>y-A e (A). 

Hence, lim inf £ j.o Ie(8/2) > 5X/2. By the arbitrariness of A we get the thesis. 

8. Exponential approximations: Proof of Proposition UTol 

The measurability of Q can be checked by straightforward arguments. Let us 
prove that Q e is continuous w.r.t. the bounded weak* topology of L\(E). As 
stated in Prop. 16.21 each map Q e (y, z) : Ms — > [0, e _1 ] is continuous and bounded. 
In addition it holds ||Q e (i?)|| < e~ 2 for all R e Ms. The thesis then follows from 
Corollary 2.7.3 in [32] . 

8.1. Proof of (|6.15p . Due to Proposition 16. II the law of Q under r^x is the same 
of the law of Q T {X T ) under F x . Moreover, it holds Qt{X t ) G L\(E) P^-a.s. In 
particular, we get that Q = Q r-r^-a.s. In addition, by Proposition ^. 6[ we have 

M ^ lo s r ?> (\\Q\\ >t) = -<*>. (8.i) 

Due to (|8.1[) in order to prove (|6 . 1 5p we only need to show for any I > that 
1 



lim lim — log Tt, x dc(Q,Qe) > 5, \\Q\\ < I 



(8.2) 



Since a G A, there exits n > 1 such that Halloo < S/(2£) for all n > n. Note 
that, since Q{y,z){R) > Q e (y,z)(R), it holds \\Q(R)\\ > ||Q e (-R)|| and ||Q(iZ)|| > 
\\Q(R) - Q e (R)\\ for any R £ Ms- Then for any n > n we have | < Q(R) - 
Q E (R),a n > | < 5/2 if ||Q(i2)|| < l- Therefore, in order to prove (|8T2|) we only need 
to show for any £ > that 

lim hm i \ogT T x (3n : 1 < n < n s.t. I < Q - Q e ,a n > I > 5/2 , IIQII < i) = -oo 

eJ.0 Ttoo T \ 1 

(8.3) 
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Since a n £ Co(E) we can find a finite subset E' C E such that |a„(e)| < 5/Al for 
all n : 1 < n < n and e € E\E'. Estimating 

| < Q-Q E ,a n > | < V \(Q(y,z)-Q £ (y,z))a n (y,z)\ + \\Q-Q e \\ sup |a„(e)| , 

< e£E\E' 



we reduce the proof of (|8.3j) to the proof of 

lim lim" 1 logE^ (|Q(y, z) - 0,(2/, z)| > /?) = -oo , V(y, z) € £, V/3 > . 

(8.4) 

This follows from ([IT?]) . 

8.2. Proof of (|6.14j) . By arguments similar to the ones used in the previous proof 
the thesis follows thanks to the bound (|6.12[) in Claim WM and (16. 6[) . 

9. Birth and death processes 

Birth and death processes are nearest-neighbor continuous time Markov chains 
on Z + with jump rates r(k, k + 1) = bk and r(k + 1, k) = e?fc+i, fc > 0. We assume 
the birth rate bk and the death rate dk to be strictly positive. We also assume 



and 



fe=0 



— — = +oo. (9.2 

fe =o ^•••6 fe 

Then assumptions (Al)-(A4) holds. Indeed, (Al) and (A3) are trivially satisfied. 
Due to the presence of a leftmost point (the origin), equation (|2.1[) reduces to the 
detailed balance equation and admits normalizable solutions if and only if (|9.1[) is 
fulfilled. In particular, one obtains a unique invariant probability given by 

,(0) = !, ^) = ^;W *>!• (9-3) 

Having (|9.1|) . condition (|9.2p is equivalent to non-explosion (A2) (combine Corollary 
3.18 in [T3] with (|9.2p ) and can be rewritten as Ylk^i l/( 7r (' e )^fc) = +oo. Note that 
condition (|9.2p is equivalent to recurrence (combine [SB] [Ex. 1.3.4] with [55] [Th. 
3.4.1]). Under the above assumptions, the logarithmic Sobolev inequality holds if 
and only if (see Table 1.4 in [12] [Ch. 1]) 

/ i \ 1 
sup?r[fc, +oo) log — — V < +oo . (9.4) 

Possible absence of exponential tightness of the empirical measure. We first dis- 
cuss a case in which the empirical measure fails to be exponentially tight. Consider 
constant birth and death rates, i.e. bk = (3 and dj. = S. Then (|9.1[) and (|9.2[) 
together are equivalent to the condition 7 := (3/5 G (0, 1). In particular, ir is geo- 
metric with parameter 7, i.e. ir(k) = (1 — 7)7 . Consider an event in which in the 
time interval [0, T] there are 0(T) jumps (typical behavior) but all the jumps are 
to the right (atypical behavior) . The probability of such an event is "only" expo- 
nentially small in T and therefore the empirical measure cannot be exponentially 
tight. To be more precise, we write Nt for the number of jumps performed in the 
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time interval [0, T]. Since the holding time at site k is exponential of parameter /3 if 
k = and /3 + 8 if k > 1, Nt stochastically dominates [is stochastically dominated 
by] a Poisson random variable with mean /3T [(/? + 5)T]. Hence, with probability 
1 - o(l), Nt has value in I := [/3T/2, 2(/3 + 6)T\. By conditioning on N T , it is then 
simple to check that with probability at least (1 - o(l))[/?/(/3 + S)] 2{f3+s)T ~ l the 
following event At takes place: the random variable Nt has value in / and all the 
jumps are to the right. Under the above event At, = SiSo ^i/T- Take now a 
compact set fC C T(V). By Prohorov's theorem, K, is a tight family of probability 
measures and therefore, given e > 0, there exists a compact (finite) set K <Z V 
such that ^(K c ) < e for all /i G /C. Taking T large enough, under the event „4r the 
empirical measure /it cannot fulfills the above requirement. Hence 

Po(mt £ /C) > P (mt(^ c ) > e) > Po(^t) > (1 - o(l))[^/(/9 + 5)] 2 ^+ 5 ) T " 1 . 

The above estimate proves that the empirical measure cannot be exponentially 
tight. In particular neither Condition 12.21 nor 12.31 holds (even with a = 0). 

Condition \2.2\ Assume now 

lim dk = +oo, lim < 1. (9-5) 

k— >oo k— too df~ 



Trivially, (|9.1j) and (|9.2j) are satisfied. We show that Condition 12.21 holds . As u n we 
pick the constant sequence u(k) = A k , k G Z + for some ^4 > 1 to be chosen later. 
Since u n does not depend on n, it is enough to check Condition 12.21 Items (i)-(iv) 
then hold trivially; moreover setting do := we get 



v(k) = (k) = d k (l - i) + 6 fc (l - A) ; 



k G Z 4 



Since r(fc) = + dfc, for each a G (0, 1) we can write v(k) — ar{k) + — cr — 
l/A) — 6fe(j4 — 1 + cr). By (|9.5p . choosing A large items (v) and (vi) hold. Observe 
that (|9.5|) is satisfied when d^ — k and 6^ = A G (0, +oo). In this case tt is Poisson 
with parameter A. This implies that e _A A fe /fc! < 7r[/c,+oo) < X k /kl (for the last 
bound estimate ir(i) < e _A A'/(fc — i)\ for i > k). Using these bounds, by simple 
computations one can check from (|9.4[) that the logarithmic Sobolev inequality 
(|2.9p does not hold. This shows there are cases in which Condition 12.21 holds but 
Condition 12.31 does not. 



Condition \2.S\ Let now focus our attention on Condition 12.31 As already men- 
tioned, the validity of the logarithmic Sobolev inequality is equivalent to (|9.4p 
(assuming (|9.1[) and (|9.2[) ). Similarly for Condition 12 . 21 the validity of (|9.4p implies 
that the function r(-) has compact level set. In fact, suppose that there exists an 
infinite subset W C N such that c := sup k€W r(k) < +oo. By detailed balance, for 
each k G W we have ir(k — l)6fe_i = dk"x(k) < cir(k). Hence, we can bound from 
below the fc-term in (|9.4p by 

1 1 1,1 

ir[k, +oo) log — • — — — — > - log ■ 



n[k, +oo) 7r(fc — c 7r[fc,+oo) 

which diverges as k goes to infinity. 

We next exhibit a choice in which Condition 12.31 holds. We take b k = (k + 1) 
and dk+i = 26fc for k > 0. Observe that such rates satisfy (|9.5[) . and therefore (|9.1j) 
and (|9.2p . The invariant probability tt is ir(k) = 2~ k ~ 1 . In remains to estimate 
Y^j=o (^(i)^') -1 = Sj=i Supposing for simplicity fc even, we observe that 
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E*=i 2 Vi < (fc/2)2 fc / 2 while E - =fe/2 2Vi < (2/fc) Ej=fe/ 2 2 J = (2/fc)2 fc / 2 £ 2' 
= (2/fc)2 fe / 2 (2' £ / 2 -l). Hence Ej=o (^O')^)" 1 ^ Ck2 k / 2 + C2 k /k. From the above 
bounds it is immediate to get (|9.4j) . In addition, since r(fc) ~ A: we deduce im- 
mediately that also item (ii) in Condition 12.31 holds, thus completing the check of 
Condition O 

Violation of the LDP in the strong topology of L\(E). By exhibiting a concrete 
example, we show that - under Condition 12.21 - Theorem 12.51 does not hold in the 
strong topology of L\(E). We choose the birth and death rates as = (k + l)/2 
and dk = k; in particular ir is geometric with parameter 1/2. Since (|9.5[) holds, 
Condition 12.21 is satisfied. We shall show that the level sets of / in (|2. 1 1|) are not 
compact in the strong topology of L\.{E). Set 

Q" '■= (l - Jl) Q n + 5 [^(n,n+l) + S(n+l,n)] ■ 

While {^ n } converges to ir in 7-'(Z + ), observe that {Q n } converges to Q 71 in the 
bounded weak* topology of L+(E) but it is not compact in the strong topology of 
L\(E). Since divQ" = 0, it is simple to check that lim„ /(/x™, Q n ) < +oo. This 
implies that the level sets of / are not compact in the strong topology of L+(E). 

Appendix A. Complements to the proof of Proposition 13.71 
We explain here how to prove the bound 

Ex (gAT {f i T ,v^ < A(7r? e v } ; VA g (Qj y CLs) (A 1} 

using the theory reported in [25j App. 1, Sec. 7] for countable Markov chains 
with sup^gy r(x) < +oo. Since the function v diverges at infinity, it is bounded 
from below and has finite level sets V n := {x <E V : v(x) < n}. We define 
v n (x) := v(x)l x <zv„ and set for x, y € V 

v (t v) - / r(x ' V) Hx eV n if x e V n 

rn[X > V) - \r(x,y)/r(x) i£x*V n 4 j if x* V n 

where Z n is the normalizing constant making 7r„ a probability measure on V . Due 
to Condition 12.31 it holds (7r,r) < +oo , thus implying that Z n is well defined and 
that lim„^oo Z n = 1. 

We notice that the function r„ : V — > (0,+oo), r n (x) := Ej/ev r n(x, y), is 
bounded from above. We then consider the continuous-time Markov chain £W 
in V with transition rates r„(-, •). Since Tr n (x)r n (x,y) = ir(x)r(x,y)/Z n , we derive 
that 7r n is the unique invariant distribution of We denote by the expec- 
tation w.r.t. the law of the Markov chain starting at x and by A n the subset 
of D([0, T];V) defined as A n = {X : X t G V n Vi G [0, T]}. Then we have 

f e XT {fiT ,v)\ = lim E x (e XT ^ T ^l An ) = lim Ei n Ue XT ^^l An ) (A.2) 

(the first identity follows from the monotone convergence theorem). Since v n and 
r n are bounded function, we can apply [251 App. 1, Lemma 7.2] and get 

E (n)( e AT<^,„„ >]u J < E (n)( e AT< TO A < gup { — D Wn (,/jl) +X(fi,V n )} . 

(A.3) 



E 
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Since v n < v we have (fj,,v n ) < (/x, u), while from the identity TT n (x)r n (x,y) = 
ir{x)r{x,y)/Z n we get At„(i/m) = D ir ( y /Jl)/Z n . Combining (IA.2I) and (|A.3|) . we 
conclude that for any £ G (0, 1) it holds 

E J e at< Mt ,„)\ < sup {_ J D^(^u)(l- £ ) + A(/X,« n )}. 

The above result, the entropy inequality and the logarithmic Sobolev inequality 
dUD imply SKA) . 

Appendix B. Proof of (|5.4p 

We call I{n,Q) the r.h.s. of (pT4"|) . Trivially it holds I((J,,Q) = +oo = I(n,Q) 
if divQ 7^ 0. In the sequel we assume divQ = 0. Then, equation (|5.4[) reads 
I(H,Q) = sup F6Cc ( E ) If{li,Q) where If{^,Q) ■= (Q,F) - (fi,r F - r). If for some 
y € V and (y, z) G E it holds = and Q(y, z) > 0, then taking F = A<5( J/ Z ) 
with A — > +oo we obtain that Q) = oo. On the other hand 

7( Ml Q) > $(Q( y , z), Q"(y, «)) = $(Q(y, z), 0) = +oo . 

As a consequence, from now on we can restrict to (/i, Q) such that div Q = and 
Q{y, z) = for all (y, z) <E E with ^(y) = 0. Calling E + := {(y, z) e £ : fj,(y) > 0} 
we get that 

Mm, q) = {Q(v> z ^ F (y> 2 ) - K»My, z)(e F(v ' z) - 1)} • 

(S,2)£B+ 

At this point, it is simple to check that, varying F(y, z), the suprcmum of the above 
addendum is given by $(Q(y, z),Q tl (y, z)) and the value of the above addendum 
for F(y, z) — is zero. Hence, 

l(n,Q)= ®(Q(y,z),Q> 1 (y,z))= HQ(y,z) 1 Q^(y,z)). 

{y,z)£E + (y,z)eE 

We now claim that the above expression is +oo if (/i, r) = +oo, thus concluding the 
proof. To this aim we observe that for < q < p/2 it holds $>(q,p) > p(l — log2)/2. 
Indeed, the thesis is trivially true if q = 0, while for q > we can write <fr(q,p) = 
pf(q/p) where f(x) = a; log a; + 1 — x. Since f(x) is decreasing for < x < 1, one 
has Q(q,p) > pf (1/2) for < q < p/2. Hence, setting c := 2/(1 — log2), our claim 
follows from the bound 

(fx,r)= £ Q»(y,z) 
(y,z)£E 

< c$(Q(y,z),Q»(y,z))+ £ 2Q(y,z) 

(y,z)£E: (y,z)£E: 
Q(y,z)<Q»(y,z)/2 Q(y,z)>Q»(y,z)/2 

< c$(Q(y,z),Q»(y,z)) + 2\\Q\\ 1 . 
(y,z)£E 

Appendix C. An example with discontinuous divergence 

Consider the oriented graph (V, E) where V — N U {v, w} and E is given by the 
oriented bonds of the form (v,n), (n,w),(w,v) for some n G N. For each n G N 
we define as the flow of unitary flux associated to the cycle (v,n,w,v), i.e. 
Q(") = !(„ n ) + I( njW ) + !(«,,„)• We claim that Q( n ) converges to Q := in 
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L\{E) (endowed of the bounded weak* topology). Since ||<3^|| = 3, the sequence 
(*5^) n gN i s bounded in the strong topology of L+(E). In particular, — > Q in 
the bounded weak* topology if and only if Q^> — > Q in the weak* topology, and 
therefore if and only if (<fi, Q^) — > ((f), Q) for each G Cq(E). By construction we 
have 

(</>, Q {n) ) = <j>(v, n) + 0(n, w) + 0(u>, «) -> «) = Q) , 

thus concluding the proof of our claim. 

We observe that, despite div<2 (Tl) = for all n G N, it holds divQ ^ 0. This 
example shows that the map L\(E) 3 Q —> divQ(x) G R, with x G V, is not in 
general a continuous map. 

Appendix D. Minimizing sequence R n for /(/z, Q) with 

( M ,Q)GP(y)xiV(^) 

In this appendix we come back to the variational problem determining I{fi, Q) 
in (|2.15p and exhibit a minimizing sequence R n £ Ms for it when Q G L+(E) and 
J(H, Q) < +oo. 

It is convenient to fix some notation. Given (/x, Q) G T'(V) x L\(E) with div Q = 
and Q(y, z) = if /x(y) = V(y, z) G £7, we consider the continuous time Markov 
chain ^onV with probability rate r(y, z) for a jump from y to z defined as r(y, z) := 
Q(y,z)//i(y), with the convention that 0/0 = 0. Let us restrict to the case of Q 
having finite support. Then all communicating classes of £ are finite and therefore 
explosion does not appear. Since div Q = the probability measure /i is an invariant 
distribution for the Markov chain £ (in the algebraic sense specified by (12.11) ). 
Applying now Theorem 3.5.6 in |36j to each communicating class of £, we conclude 
that the Markov chain £ starting with distribution (i is stationary. In what follows, 
we write P[/x, Q] for the law on D(R; V) of the stationary Markov chain £ with 
marginal fi. Then P[/x, Q] G Ms, the associated flow Q equals Q while the entropy 
H(P{n,Q]) can be easily computed. Indeed, combining (|3.1j) with definition (|6.1j) 
we conclude that 

H(V\jjl,Q]) =E P[ ,, Q ][ £ Qr(y, z) log Q( J; Z) - £ Mr(y)(%)-r(y))] . 

Since <5 has finite support, the integrand in r.h.s. of the above formula is given by 
a finite sum and, commuting sum with expectation, we get 

H(P[/i,Q])= ^{Q{y,z),Q ll {y,z)) , Q^{y,z) = i i{y)r(y,z). (D.l) 

{y,z)£E 

Since I(n,Q) = I(fj,,Q) < +oo, we know that it must be (/i,r) < +oo, divQ = 
and that Q(y, z) = if fi(y) = 0. If Q has finite support, due to (|D.1|) we conclude 
that H (P[/i, Q]) = /(/x, Q), thus proving our claim. In order to treat the general case 
we observe that by Lemma ETTl we can write Q = J2cec Q(^)^c- We fix an invading 
sequence V n /• V of vertex sets such that, setting E„ := {(x, y) EE : x, y G V n } 
and Q n := X/CeC: ccb„ ^(C)^, h holds ||<3-Q„|| <2 "|jQ||. It is trivial to check 
that there exists a partition { Jn }k>i of the set {C G C : C (t E n } such that 
(i) Jn is a finite set for all k > 1; 
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(ii) Setting Q { * ] := £ T (« Q(C)Ic it holds ||Q^|| < 2- fc+1 ||Q - Q n 



Note that, due to the above conditions, it holds \\Qn\\ < 2~ k - n+1 \\Q\ 
Setting 7„ := 1 — 2~ n and ai := 2~ n_fe , the convex combination 



R„ := 7n P[ M , Q n / ln ] + £ a«P[/i, Q^V^ fc) ] 
fc=i 

is a stationary process in Ms such that Q{R n ) = Q, p,{R n ) = fi. At this point, it 
remains to prove the following claim: 

Claim D.l. It holds Q) > lim„_>oo H(R n ). 

Proof. By the convexity of H proved in [17]— (IV) we can bound 



H(R n ) < ln H (P[/x, Q n / ln ]) + J2 a( n ] H (P[M, Qi k) /al k 

k=l 



To compute the above entropies we use formula (|D.1[) . getting 

H(V\p,Q n / ln ])= ®(Qn(y,z)/j n ,Q»(y,z)) , (D.2) 

(v,z)eE 

ff(p[ M ,gW /««])= ^ $(gW(y,z)/aW,Q^(y,z)) . (D.3) 

In order to study the contribution of (|D.2|) take 7 e (0, 1), p > and < g < q'. 
Then (with the convention that log = 0) we get 



< 7$(-,p) < qlog - + glog — + ■yp < qlog — + q\og — + "fp 

7 PI PI 

q' 1 
< q' log —l(q' > p) + q log - + 7p 

P 7 

= [$(</, p) + q' -p] l(q' >p) + q\og-+jp< $(q',p) + q' + q' log - + 1P . 

1 1 



Applying the above bound to the case q = Q n {y,z), q' = Q(y,z), p = Q ti {y,z) 
and 7 = 7„, by the conditions I(fj,,Q) < +00, ||Q|| < +00, ||Q M || < +00 and the 
dominated convergence theorem we conclude that the r.h.s. of (jD.2|> converges to 
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In order to study the contribution of (|D.3j) we observe that 

o 

Y.c&EfaQP /<£>]) 



k=l 



E E 



log^4+log(l/a«) 



< E (0-On)(».«)log 



Q(y, 



-||Q-Qn|| + (l-7n)IIQ' 1 || 

^||Q( fc )||log(l/a( fe )) + (l- 7 „)||g^|| 



k=l 



E - *) l0 S 7^4 + E H^ll l0 S(lM fc) ) + (1 - 7«)I|Q1 

(y,z)€E: V ^' ' fe=l 

Q(y,z)>Qf(y,z) 

(D.4) 

Let us analyze the last member. Since HQ^H < 2 _fe -> l + 1 j|Q| and since 7„ — > 1 the 
last two terms in the last member goes to zero. In remains to control the first sum 
in the last member. Since for (y, z) G E such that Q(y, z) > Q^(y, z) it holds 

< (Q - Q„)(y, z) log Z \ < $ (Q(y, z), Q»(y, z)) + Q(y, z) 

and the above r.h.s. is summable as (y,z) varies in E (recall that I(fi,Q) < +oo), 
by the dominated convergence theorem we conclude that the first sum in the last 
member of (|D.4[) is zero as n — > oo. Coming back to (|D.4[) we have 



77, — >00 ^ ' 



fc = l 



□ 
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